Playing with the language modeling abilities of gzip | Hacker News - But Better

Playing with the language modeling abilities of gzip dreamstation.systems

Exploring whether gzip can generate text by treating compression as prediction.

3 points•robinpie•4 days ago•1 comment•

#gzip #modeling #abilities #playing #language modeling #modeling abilities #language modeling abilities #exploring

1 comment

michaelastreiko4 days ago

A nice reminder that compression can act like a tiny implicit model; the failure modes are as interesting as the successes.

Read the full thread on Hacker News →

Related stories

Log-Depth Recurrent Language Modelingarxiv.org
Hacker News · 1 points · 7 days ago
AI-Powered Financial Modeling Works Nowmodeloptic.com
Hacker News · 1 points · 1 day ago
Exploring the scalable matrix extension of the Apple M4 processorgithub.com
Hacker News · 2 points · 10 days ago
Can gzip be a language model?nathan.rs
Hacker News · 398 points · 9 days ago
Gzip 1.15 Released with Many Longtime Bugs Fixedfossforce.com
Hacker News · 1 points · 10 days ago
A Colab sandbox for exploring the Drosophila connectomedrive.google.com
Hacker News · 3 points · 9 days ago