hyperhypervisor @programming.dev
Posts 0
Comments 7
Sovcit needs some help. 5 0
Oh I'm not defending the Sovcit in the slightest. I'm just pointing out that the license still works in the same way as a software license, but the license is for the roads.
Reply
Sovcit needs some help. 9 0
actually, that usage makes sense if you realize that you're licensing the roads, not the car.
Reply
[Resource] Llama3 70B Successfully Deployed on a Single 4GB GPU 2 0
No, they just mention that only Apple silicon is supported if you're using MacOS
Reply
Getting Started with Self Hosted LLM 4 0
Ok. I haven't tried it so I'll take your word for it. I'm just offering an easier alternative since the topic was "getting started"
Reply
Getting Started with Self Hosted LLM 5 0
Iirc it can run anything llama.cpp can because it just uses that under the hood.
Reply
Getting Started with Self Hosted LLM 8 0
There's also llamafile, super simple: download and run it.
Reply
Markdown tests 2 0
Markdown is not respected in post preview (can't attach an image apparently, but many posts on news communities will have a quote)
Reply
Next