Bonsai 2 27B: 5.9 GB of weights for a 27B model | Hacker News - But Better

Bonsai 2 27B: 5.9 GB of weights for a 27B model twitter.com

We just released Ternary Bonsai 2 27B: 5.9 GB of weights for a 27B model. How much reasoning survived compression? We test it on a few evals that I found interesting and discuss where it retains the performance of the…

2 points•tosh•8 days ago•0 comments•

#27b #weights #bonsai #27b model #survived #ternary #reasoning #just

0 comments

No comments yet.

Related stories

Can Cloudflare CEO Matthew Prince save the web from AI?theverge.com
The Verge · 0 points · 4 days ago
Can John Ternus find Apple’s next big thing?theverge.com
The Verge · 0 points · 9 days ago
The SaaSpocalypse that wasn’t, with Atlassian CEO Mike Cannon-Brookestheverge.com
The Verge · 0 points · 2 days ago
Does AI need an antitrust exemption so it doesn’t kill everyone????theverge.com
The Verge · 0 points · 11 days ago
I have some questions for Mark Zuckerbergtheverge.com
The Verge · 0 points · 6 days ago
Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprintprismml.com
Hacker News · 575 points · 13 days ago