Every day NerfTracker gives each coding agent the same jobs on a fresh machine, then records what it builds.
1 comment
creepy1 day ago
All models receive the same written prompt with 1 shot at each. They will use their code editor of choice (Claude Code, Codex or Grok Build) at max thinking and no human intervention. All runs start from a fresh macos user profile with default installation of macos. Sandboxed. No memory/session/cache/process carry over. State is confirmed using a checksum pre and post run. Search is available and runs are timed.
Read the full thread on Hacker News →
Related stories
- Hacker News · 5 points · 9 days ago
- Hacker News · 1 points · 10 days ago
- Hacker News · 2 points · 7 days ago
- My coding agent pushed a commit deleting every file on maindev.karakun.comHacker News · 4 points · 5 days ago
- Hacker News · 7 points · 6 days ago
- Launch HN: Vespper (YC F24) – SOTA Docx MCPvespper.comHacker News · 31 points · 2 days ago