Per-step reasoning effort for Claude Code, chosen by Jev, without breaking the prompt cache. Unofficial. - ifoster01/jev-effort
2 comments
ethan19986 days ago
If you change reasoning during a session, LLM needs to recompute KV cache. Maybe I get it wrong, but I don't think it can save money.
ifoster41901about 21 hours ago
The newer models from both OpenAI and Anthropic allow you to dynamically change reasoning effort without resetting cache
Read the full thread on Hacker News →
Related stories
- Hacker News · 1 points · 8 days ago
- Lobsters · 3 points · 6 months ago
- Hacker News · 1 points · 2 days ago
- Lobsters · 86 points · about 1 year ago
- Hacker News · 2 points · 7 days ago
- Hacker News · 1 points · 6 days ago