Related stories

• Show HN: Jeva.cpp – a llama.cpp fork with JEV-compatible API for all LLMsgithub.com
  Hacker News · 2 points · 5 days ago
• Show HN: Llama.cpp fork with 2-4x multiGPU speed for MoE models bigger than VRAMgithub.com
  Hacker News · 1 points · 8 days ago
• Faster prompt lookup drafting in llama.cppjadidbourbaki.github.io
  Hacker News · 70 points · 7 days ago
• Using Llama-cpp-Python grammars to generate JSONtil.simonwillison.net
  Hacker News · 1 points · 10 days ago
• Llama.cpp Under the Hoodcppdepend.com
  Hacker News · 2 points · 10 days ago
• Custom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and Moredoug.sh
  Hacker News · 2 points · 7 days ago