benchmark

61 stories and discussions about benchmark, aggregated from every source we track.

1.

Benchmark for tracking model capability after release. - ninjahawk/livenerf

910 points•bryan0•about 2 months ago•388 comments•
2.

A benchmark where frontier language models drive a real comma-equipped Toyota through a cone course, one command at a time, with a human supervisor ready to brake.

311 points•plurby•about 2 months ago•248 comments•
3.

52 Jev-class systems tested on 534 decisions. Jev 1.13.0 leads JevBench v1.3.0 with 74.4; compare open-source, self-hostable and hosted options.

149 points•florianstandhar•2 months ago•39 comments•
4.

OpenAI's involvement in funding FrontierMath, a leading AI math benchmark, only came to light when the company announced its record-breaking performance on the test. Now, the benchmark's developer Epoch AI…

76 points•river•almost 2 years ago•26 comments
5.

Uncensored AI models or those fine-tuned for cybersecurity tasks. - JoasASantos/Offensive-Security-AI-Models

31 points•soltanov•about 2 months ago•9 comments•
6.

This is a submission for the Kaggle Benchmarking Challenge What I Benchmarked Current...

25 points•kakeroth•about 2 months ago•0 comments
7.

This article is a submission for the Kaggle Benchmarking Challenge. "I told an AI something was...

20 points•rajan_mishra_a9f78ad216b4•about 2 months ago•1 comment
8.

LLM Benchmark - One prompt, Multiple models, Multiple dates

10 points•fragmede•2 months ago•5 comments•
9.

There's a test suite for security scanners where 47% of the test cases are deliberately designed to...

8 points•alimafana•about 2 months ago•0 comments
10.

Discover how Gubernator revolutionizes container orchestration by natively baking in ENS RD 311/2022, EU NIS 2, EU DORA (Reg. 2022/2554), CIS Docker Benchmark, ISO 27001, SHA-256 audit ledger, Cosign, and SBOM into a single sovereign Go binary.

8 points•marioezquerro•2 months ago•0 comments
11.

I published a memory benchmark six days ago. I spent most of the build trying to make it fair rather...

7 points•woochan•about 2 months ago•4 comments
12.

This is a submission for the Kaggle Benchmarking Challenge What I Benchmarked ...

6 points•nishikantaray•about 2 months ago•5 comments
13.

Benchmark TypeScript 7 safely, compare real project results, and find compatibility problems before changing your main branch.

5 points•johnnylemonny•about 2 months ago•0 comments
14.

On GitHub Actions' standard macOS runner, a Firefox for iOS build takes over 12 minutes and on Avrea with a warm cache it takes just under 2 minutes. Mastodon, built with Tuist, goes from 4 minutes 30 seconds to 12…

5 points•leolannenmaki•about 2 months ago•2 comments•
15.

C++ vs Node.js HTTP benchmark with wrk: Crow 5.4k req/s, Node http 12k, uWebSockets 57k. Same route, same laptop, with code and why Crow lost to Node.

5 points•vikky2810•about 2 months ago•1 comment•
16.

The World's First Information-Theoretic Search Engine. Deploy a complete, sovereign AI search stack into your VPC, on-prem or on edge.

4 points•supportm•about 2 months ago•0 comments•
17.

DoGBench evaluates whether agents identify when user-facing software documentation needs updating and produce useful patches, using rubrics calibrated with project maintainers.

3 points•prithvi2206•about 2 months ago•1 comment•
18.

Benchmark of TypeSafe's Jev against Sonnet 5, GPT-5 nano and local LLMs on 770 Reddit AITA verdicts: Brier scores, latency and cost - dchristopoulos/jev-aita

3 points•dchristopoulos•about 2 months ago•0 comments•
19.

Benchmark for tracking model capability after release. - ninjahawk/livenerf

3 points•ninjahawk1•2 months ago•0 comments•
20.

A browser-first AI poker benchmark. Seat Jev and OpenAI-compatible models at the same no-limit Texas Hold'em table, watch every card and decision as a spectator, and let the tournament run auto...

3 points•arthuqa•2 months ago•1 comment•
21.

TypeSafe's Jev against four shipped prompt-injection detectors on 7,803 labeled messages and 296 conversations. It wins the curated benchmark and the newest attack set, loses two older ones, and its probabilities track…

3 points•ramoz•2 months ago•0 comments•
22.

WebAssembly runtimes keep improving every day and quite a few things havechanged since the last time I benchmarked WebAssembly runtimes using libsodium.

3 points•calvin•about 7 years ago•0 comments
23.

Our benchmark shows OpenAI’s Dots defaults to its own platform, powered by Cloudflare, rather than separate third-party services when building apps.

2 points•thestackfox•about 2 months ago•0 comments•
24.

KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs) - ScalingIntelligence/KernelBench

2 points•peter_d_sherman•about 2 months ago•0 comments•
25.

Exploring products at the intersection of Design & AI

2 points•jeffpersonified•about 2 months ago•1 comment•
26.

Measurement harness for proxy providers, browser engines and scraping targets. Every claim carries the run it came from. - nodemaven/proxy-benchmark

2 points•pia-nm•about 2 months ago•0 comments•
27.

See how Jev performs in a benchmark of 19 reranker configurations across five datasets, covering accuracy, latency, and prompt-driven relevance for LanceDB search.

2 points•ifoundanifty•about 2 months ago•0 comments•
28.

Benchmark for tracking model capability after release. - ninjahawk/livenerf

2 points•ninjahawk1•about 2 months ago•0 comments•
29.

This is a submission for the Kaggle Benchmarking Challenge. Every day, agents book invoices, check...

2 points•ridhoajaaa•about 2 months ago•4 comments
30.

Introducing webgpu-bench, the micro-benchmark suite behind Web3D Survey’s GPU benchmark, with measurements of shader operations and code patterns available through a webpage and CLI.

2 points•ibobev•about 2 months ago•1 comment•
31.

Browser stacking work-cell for embodied agents. VLA track: camera and language. Scores written by the harness, not the client.

2 points•AranKair•about 2 months ago•0 comments•
32.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

2 points•akamor•about 2 months ago•1 comment•
33.

We benchmarked 11 speech-to-text engines on 265 real recordings with a competing voice in the room. See where voice isolation helps.

2 points•davitb•about 2 months ago•0 comments•
34.

Choose the best model for the work you do

2 points•Garbage•2 months ago•0 comments•
35.

Our own benchmark of typed-decision models: Jev, its open rebuilds and instruction models on the JevBench Score — Intelligence, Calibration, Speed and Cost, 25 % each, geometric mean.

2 points•oscarfr•2 months ago•0 comments•
36.

Measurement harness for proxy providers, browser engines and scraping targets. Every claim carries the run it came from. - nodemaven/proxy-benchmark

2 points•pia-nm•2 months ago•0 comments•
37.

Does the code do what it says? A benchmark for catching the gap between documentation and reality. - 02zerocool/truth-benchmark

2 points•o2zer0cool•2 months ago•0 comments•
38.

A single-image handedness decision: probabilities, visual evidence, original prompt, and JSON output.

1 points•cyptus•about 2 months ago•0 comments•
39.

ScholarCatalyst: a benchmark for retrieving papers that inspire new research.

1 points•matt_d•about 2 months ago•0 comments•
40.

Benchmark-driven Rust PDF reader, CLI and desktop viewport with reproducible per-workload performance comparisons - marksmayo/blazepdf

1 points•beatthatflight•about 2 months ago•1 comment•
41.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

1 points•codelion•about 2 months ago•0 comments•
42.

An 82% on the leaderboard could be about 57% on real finance workflows. Here's what to take off, and why.

1 points•luhe1900•about 2 months ago•0 comments•
43.

The Hutter Prize requires no validation data, so its scores cannot be inflated by data leaks. Three entries, each running on a single CPU core, just improved its record by nearly 10%.

1 points•jabowery•about 2 months ago•1 comment•
44.

Current AI safety evaluation and benchmarking frameworks predominantly rely on Western-centric culture-agnostic defaults that mask critical regional laws, socio-linguistic nuances, and cultural taboos, leaving…

1 points•thinkevolve•about 2 months ago•0 comments•
45.

runescape-bench evaluates AI coding agents on their ability to play RuneScape.

1 points•luu•about 2 months ago•0 comments•
46.

Most benchmarks hand the model a question. EnigmaForge hands it a stack of old documents and no question at all. Buried in the letters, receipts, and logbook margins is a small logic puzzle whose solution is unique -…

1 points•robottwo•about 2 months ago•0 comments•
47.

See which LLMs lead the July 2026 EDA Benchmark for exploratory data analysis, comparing accuracy, repeatability, and reliability-adjusted scores.

1 points•nvmdbljstm•about 2 months ago•1 comment•
48.

FAB: a benchmark for AI agents doing financial due diligence - SecondState-ai/finance-agents-benchmark

1 points•ELAmrani•about 2 months ago•0 comments•
49.

How UIUC++ SRSE students turned real-world failure postmortems into SREGym benchmark problems, with lessons on fault fidelity, mitigation oracles, and quality control.

1 points•matt_d•about 2 months ago•0 comments•
50.
1 points•tonychang430•about 2 months ago•0 comments•
51.

Frontier language models are rarely used in clinical workflows because the realistic, longitudinal benchmarks needed to develop them are scarce. Real electronic health record (EHR) data cannot be openly shared due to…

1 points•simonpure•about 2 months ago•0 comments•
52.
1 points•austin2020•about 2 months ago•0 comments•
53.
1 points•grigio•about 2 months ago•0 comments•
54.

A benchmark for AI-discovered numerical solvers: fast, accurate, and general solutions to large sparse linear systems.

1 points•hgarud•2 months ago•0 comments•
55.
56.

A free, public dataset for measuring name and entity accuracy in speech recognition. See the audio, the annotations, the scorer, and how Modulate scores.

1 points•voicevector5•2 months ago•0 comments•
58.

Five free tools for B2B outbound: a LinkedIn message generator, reply rate calculator, ICP fit scorer, voice note script generator and ROI calculator. All built from 389,890 measured prospects. No sign-up.

1 points•cassidy01•2 months ago•0 comments•
59.

Compete in short reflex, memory, focus, and precision tests. Save your scores, compare rankings, and climb HumanRank leaderboards.

1 points•maxiom•2 months ago•0 comments•
60.

Claude Opus 5.5 nerf claims finally meet a day-0 baseline: livenerf tests it daily for 30 days. First possible call: around October 24.

0 points•axrisi•about 2 months ago•0 comments

Related topics