Why do OpenAI's GPT-2 weights beat mine? Part five: data quality | Hacker News - But Better

Why do OpenAI's GPT-2 weights beat mine? Part five: data quality gilesthomas.com

Does improving the training data quality help me close the gap between my models and the original GPT-2 small on my IFT eval?

2 points•gpjt•about 3 hours ago•0 comments•

#data #gpt #quality #data quality #beat #mine #weights #openais

0 comments

No comments yet.

Related stories

The People of Utah vs. Kevin O’Learytheverge.com
The Verge · 0 points · about 10 hours ago
Inside our months-long investigation into Kevin O’Leary’s Utah data center debacletheverge.com
The Verge · 0 points · about 6 hours ago
Show HN: Codex shorthand levels with -vvv style more or less
Hacker News · 1 points · about 7 hours ago
OpenAI says planned GPT-6.1 is too insecure to releasearstechnica.com
Ars Technica · 0 points · 2 days ago
What Changed from GPT-3.5 to GPT-4? GPT-3.5: 0/30 Empty Nulls. GPT-4: 30/30reddit.com
Hacker News · 2 points · 8 days ago
Show HN: Beyond "chat with your database" – agentic data explorationreportr.com
Hacker News · 1 points · 1 day ago