Two models on the same JevBench problems: paired accuracy and model answer speed.
1 comment
ljlolel7 days ago
I've made a new model `gev` that outperforms `jev` in accuracy on JevBench and it takes image input too (unlike jev), and gev can be faster too!
also this AnyEval we made is great. can set up any model vs model comparisons for any benchmark
full traces. cryptographically signed
Read the full thread on Hacker News →
Related stories
- Hacker News · 1 points · 9 days ago
- The Verge · 0 points · 8 days ago
- Hacker News · 3 points · 3 days ago
- Hacker News · 1 points · 5 days ago
- Hacker News · 7 points · 11 days ago
- Hacker News · 2 points · 6 days ago