The quantized model you can run locally works decently and they can't read any of it, which is nice.
I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf
If you're looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
54 4 ReplyIf you're ready to tinker a bit i can recommend Ollama for the backend and Open web UI for the frontend. They can also both run on the same machine.
The advantage is that you can use your GPU to compute, which is a lot faster.
16 0 ReplyPretty sure LM studio is not open source
12 0 ReplyYou're right, I thought they were but I checked their GitHub and LM Studio itself isn't.
7 0 Reply
It won’t fuck off even if you ask it how to disable it gives you bullshit answers. Some “AI”.
27 0 ReplyYeah first thing I did was ask it how I could dissable it.
10 0 ReplyAt least the new windows copilot told me how to disable it.
5 0 ReplyIt finds it way to you in many forms, even if you disable it in one place.
Taskbar, Startmenu, Edge browser, the new Office to name a few.
They will push it wether you like it or not
1 0 Reply
I just blocked its user account
Don't see any option to block it on messenger yet
3 0 ReplyWhat happens if you ask it to create Prof Farnsworth saying “Fuck Off”?
Could you then use the AI generated Farnsworth to instruct the AI to Fuck Off?
2 0 Reply
Where are you guys running into this? I thought for the most part tech people dropped anything associated with meta
20 0 ReplySome people are ‘forced’ to use WhatsApp due to it being the messaging platform of choice for a lot of people.
22 1 ReplyOh gotcha, I kinda forgot that was under the meta umbrella
8 0 ReplyYou're not forced to see anything.
1 5 Reply
For me it's WhatsApp because it's the defacto group messaging choice
5 0 Replyyour defacto group messaging choice
Don't throw all of us under that bus, please and thanks
8 4 Reply
"Who are those horrible orange creatures over there?"
"Why, those are the Grunka Lunkas. They work here in the Slurm factory."
"Tell them to fuck off!"
12 0 ReplyAt least meta AI actually releases most of their models, and publishes research papers about the ones they don’t.
3 0 ReplyThere are couple of things you have to do different if you're the underdog, don't make it a good guy Meta argument.
The models are marketing, and we can be fine with it.
1 0 Reply