Self-Play Pretraining with Zero Data | Hacker News - But Better

Self-Play Pretraining with Zero Data arxiv.org

Advances in language modeling have been driven by scaling pretraining on ever more data. Yet, the training data is still largely curated on the model's behalf. A more general approach to pretraining would let the model…

3 points•7777777phil•1 day ago•0 comments•

#data #pretraining #play #zero #self #self play #play pretraining #zero data

0 comments

No comments yet.

Related stories

Self-Play Pretraining with Zero Dataarxiv.org
Hacker News · 2 points · 5 days ago
Show HN: Datastory, Data storytelling with AI and an open knowledge graphdatastory.tech
Hacker News · 6 points · about 8 hours ago
Show HN: Beyond "chat with your database" – agentic data explorationreportr.com
Hacker News · 1 points · about 8 hours ago
Physical Self-Playskild.ai
Hacker News · 2 points · 7 days ago
Show HN: Capsule – Single-file web apps that save their data into SQLitewithcapsule.app
Hacker News · 377 points · 15 days ago
Google's first Suncatcher orbital data center test launches October 1arstechnica.com
Ars Technica · 0 points · 6 days ago