Heimr 570M is a 2.7B-parameter, 570M-active hybrid of Mamba-3 and Heimr attention with mixture-of-experts layers, built for phones and laptops. Its decode throughput and memory stay nearly flat to 64K tokens of…
0 comments
No comments yet.
Related stories
- Hacker News · 2 points · 7 days ago
- Hacker News · 1 points · 2 days ago
- Hacker News · 6 points · 10 days ago
- Hacker News · 3 points · 10 days ago
- Ars Technica · 0 points · 8 days ago
- Hacker News · 1 points · 9 days ago