HN
login
Log-Depth Recurrent Language Modelingarxiv.org

Language modeling using Transformers has become commonplace despite their fixed computational depth and quadratic runtime with respect to input tokens. Recurrent models on the other hand offer linear depth but no…

1 points•E-Reverance•7 days ago•0 comments•
#depth#modeling#recurrent#language modeling#log#log depth#recurrent language#depth recurrent

0 comments

No comments yet.

Related stories