Skip Navigation

cl-llama.cpp demo

mstdn.io veer66 (@[email protected])

Attached: 1 video cl-llama.cpp is llama.cpp's Common Lisp wrapper by Carlos Ungil. It allows us to use LLMs locally via Common Lisp. I modified it to use the updated llama.cpp API, and improved how it prints the output. You can get the modified version by running: [email protected]:veer66/cl-llama....

veer66 (@veer66@mstdn.io)

cl-llama.cpp is llama.cpp's Common Lisp wrapper by Carlos Ungil. It allows us to use LLMs locally via Common Lisp. I modified it to use the updated llama.cpp API, and improved how it prints the output.

0
0 comments