HN
login
Self-Play Pretraining with Zero Dataarxiv.org

Advances in language modeling have been driven by scaling pretraining on ever more data. Yet, the training data is still largely curated on the model's behalf. A more general approach to pretraining would let the model…

4 points•E-Reverance•5 days ago•0 comments•
#data#pretraining#play#zero#self#self play#play pretraining#zero data

0 comments

No comments yet.

Related stories