We introduce Context Language Models (CLMs), language models that natively manage their own context. We implement this by treating the context as a file and allowing the model to make unrestricted updates to this file.…

3 points•tomatomatomato•about 13 hours ago•1 comment•

1 comment

tomatomatomatoabout 13 hours ago
The Bitter Lesson for context management: Giving LMs unrestricted control over their context beats human-designed SOTA!

Introducing Context Language Models (CLMs) - Natively manage their own context - Treat context as a file - Learn policies in CLM weights, no harness

Check out our paper, code, and play with CLM! Paper: arxiv.org/abs/2609.37725 Code: github.com/facebookresearch/context-language-models HF paper: huggingface.co/papers/2609.37725

Read the full thread on Hacker News →

Related stories