Custom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and More | Hacker News - But Better

Custom Models in Oh My Pi: vLLM, Llama.cpp, SGLang and More doug.sh

How to point Oh My Pi at vLLM, llama.cpp, SGLang, and other local servers or a gateway, plus two config fixes for omp 18.2.7 and later.

2 points•dougcalobrisi•5 days ago•0 comments•

#cpp #vllm #sglang #llama #custom #custom models #local #point

0 comments

No comments yet.

Related stories

Show HN: Jeva.cpp – a llama.cpp fork with JEV-compatible API for all LLMsgithub.com
Hacker News · 2 points · 2 days ago
Show HN: Llama.cpp fork with 2-4x multiGPU speed for MoE models bigger than VRAMgithub.com
Hacker News · 1 points · 5 days ago
Show HN: Ox – A local agent that uses the internet for youopenox.ai
Hacker News · 2 points · 7 days ago
Show HN: Reflex Engine Beats Both Llama.cpp and vLLM on Cold-Start to TTFTgithub.com
Hacker News · 1 points · about 23 hours ago
ContextMemory – Markdown memory for your llama.cpp/vLLM servergithub.com
Hacker News · 1 points · 1 day ago
Cities across US oppose Trump FCC plan to preempt local broadband rulesarstechnica.com
Ars Technica · 0 points · 8 days ago