How well does Jev hold up on the decisions a company actually makes?
Our team tested it on 1,071 real cases across 11 domains, from finance to legal to support.
The result: 93.8% accuracy, under half a second per answer, about four cents per 1,000.
Made decisionbench.ai to test because I wanted to see how well Jev actually performs compared to other models.
Tested 12 models across 35 tasks. Jev did really well for how little it costs. Wrote up what I found 👇
Article
Putting Jev to the test with Decision Bench
12 AI models tested on 1,071 cases across 35 tasks and 11 domains.
With all the hype around Jev and the experiments people were sharing, I wanted to see how useful it actually was.
I was interested in...
