An inference engine for generative recommendation: catalog-constrained wide beam search, executed inside CUDA graphs. https://github.com/sohu-mptc/FlashRec
An inference engine for generative recommendation: catalog-constrained wide beam search, executed inside CUDA graphs.
https://github.com/sohu-mptc/FlashRec
0 comments
No comments yet.
Read the full thread on Hacker News →
Related stories
- Hacker News · 1 points · 2 days ago
- Hacker News · 421 points · 6 days ago
- Hacker News · 3 points · 3 days ago
- Hacker News · 1 points · 4 days ago
- Hacker News · 1 points · 6 days ago
- Hacker News · 2 points · about 9 hours ago