Heimr 570M is a 2.7B-parameter, 570M-active hybrid of Mamba-3 and Heimr attention with mixture-of-experts layers, built for phones and laptops. Its decode throughput and memory stay nearly flat to 64K tokens of…

1 points•ilreb•about 12 hours ago•0 comments•

0 comments

No comments yet.

Related stories