We introduce Context Language Models (CLMs), language models that natively manage their own context. We implement this by treating the context as a file and allowing the model to make unrestricted updates to this file.…
1 comment
tomatomatomatoabout 13 hours ago
The Bitter Lesson for context management: Giving LMs unrestricted control over their context beats human-designed SOTA!
Introducing Context Language Models (CLMs) - Natively manage their own context - Treat context as a file - Learn policies in CLM weights, no harness
Check out our paper, code, and play with CLM! Paper: arxiv.org/abs/2609.37725 Code: github.com/facebookresearch/context-language-models HF paper: huggingface.co/papers/2609.37725
Read the full thread on Hacker News →
Related stories
- Hacker News · 377 points · 16 days ago
- Hacker News · 1 points · 2 days ago
- DEV Community · 8 points · 20 days ago
- Lobsters · 33 points · 6 days ago
- Hacker News · 1 points · 1 day ago
- Hacker News · 1 points · 9 days ago