Nemotron-H: A Family of Accurate, Efficient Hybrid Mamba-Transformer Models

Nemotron-H: A Family of Accurate, Efficient Hybrid Mamba-Transformer Models research.nvidia.com

Nemotron-H is a series of hybrid Mamba-Transformer models which offer either better or on-par accuracy and improved inference speed (up to 3x) compared to other similarly-sized state-of-the-art open-sourced pure…

1 points•Bluestein•8 days ago•0 comments•

#mamba #transformer #nemotron #hybrid #transformer models #hybrid mamba #mamba transformer #family

0 comments

No comments yet.

0 comments

Related stories