AI Benchmark Scores: Why 82% is actually 57% | Hacker News - But Better

AI Benchmark Scores: Why 82% is actually 57%lessuncertain.substack.com

An 82% on the leaderboard could be about 57% on real finance workflows. Here's what to take off, and why.

1 points•luhe1900•about 5 hours ago•0 comments•

#ai #actually #benchmark #scores #ai benchmark #benchmark scores #ai benchmark scores #leaderboard

0 comments

No comments yet.

Read the full thread on Hacker News →

Related stories

Can Cloudflare CEO Matthew Prince save the web from AI?theverge.com
The Verge · 0 points · 6 days ago
The SaaSpocalypse that wasn’t, with Atlassian CEO Mike Cannon-Brookestheverge.com
The Verge · 0 points · 4 days ago
Can you forget how you feel about Meta?theverge.com
The Verge · 0 points · 10 days ago
Can John Ternus find Apple’s next big thing?theverge.com
The Verge · 0 points · 11 days ago
Show HN: Training a model to identify AI web content from structure alonearxiv.org
Hacker News · 73 points · 10 days ago
Inside our months-long investigation into Kevin O’Leary’s Utah data center debacletheverge.com
The Verge · 0 points · about 16 hours ago