Every day NerfTracker gives each coding agent the same jobs on a fresh machine, then records what it builds.

1 points•creepy•1 day ago•1 comment•

1 comment

creepy1 day ago
All models receive the same written prompt with 1 shot at each. They will use their code editor of choice (Claude Code, Codex or Grok Build) at max thinking and no human intervention. All runs start from a fresh macos user profile with default installation of macos. Sandboxed. No memory/session/cache/process carry over. State is confirmed using a checksum pre and post run. Search is available and runs are timed.

Read the full thread on Hacker News →

Related stories