Saving up to 70% of an agent's tokens on work it already did

Saving up to 70% of an agent's tokens on work it already did vshulcz.github.io

Eight tools on a machine with 19,195 sessions already on disk, asked 100 questions only that history answers: build time, first answer, hit@1.

2 points•vshulcz•6 days ago•1 comment•

#already #saving #agents #tokens #agents tokens #machine #eight #tools

1 comment

vshulcz6 days ago

The corpus is LongMemEval chat logs rather than real coding sessions, because I needed a set where exactly one session answers each question, and no real laptop gives you that. It's the weakest part of the setup. Drivers and the corpus builder are in the repo if anyone wants to rerun a row.

Read the full thread on Hacker News →

1 comment

Related stories