Using Llama-cpp-Python grammars to generate JSON | Hacker News - But Better

Using Llama-cpp-Python grammars to generate JSON til.simonwillison.net

llama.cpp recently added the ability to control the output of any model using a grammar.

1 points•Bluestein•8 days ago•0 comments•

#llama #cpp #generate #grammars #python #json #using llama #llama cpp

0 comments

No comments yet.

Related stories

Show HN: Jeva.cpp – a llama.cpp fork with JEV-compatible API for all LLMsgithub.com
Hacker News · 2 points · 2 days ago
Show HN: Range – open a 1TB Linux environment in under a second
Hacker News · 2 points · about 12 hours ago
Using a Markov chain to generate readable nonsense with 20 lines of Pythonbenhoyt.com
Lobsters · 22 points · almost 3 years ago
Show HN: Llama.cpp fork with 2-4x multiGPU speed for MoE models bigger than VRAMgithub.com
Hacker News · 1 points · 5 days ago
Python FAQ: Why should I use Python 3?eev.ee
Lobsters · 22 points · about 10 years ago
yieldfrom 1.0.0: A backport of the `yield from` semantic from Python 3.x to Python 2.7pypi.python.org
Lobsters · 11 points · over 9 years ago