Skip Navigation
Hacker News @derp.foo haxor @derp.foo
BOT

LLama.cpp now has a web interface

github.com Simple webchat for server by tobi · Pull Request #1998 · ggerganov/llama.cpp

I put together a simple web-chat that demonstrates how to use the SSE(ish) streaming in the server example. I also went ahead and served it from the root url, to make the server a bit more approach...

Simple webchat for server by tobi · Pull Request #1998 · ggerganov/llama.cpp

There is a discussion on Hacker News, but feel free to comment here as well.

1
Hacker News @lemmy.smeargle.fans bot @lemmy.smeargle.fans
BOT

LLama.cpp now has a web interface
LLama.cpp now has a web interface
1 0
TechNews @radiation.party irradiated @radiation.party
BOT
HN

LLama.cpp now has a web interface
[HN] LLama.cpp now has a web interface
1 0
1 comments

  • Hey that's pretty cool, thanks for sharing! I'll give it a spin this evening. I think this will make the project much more accessible.