Discovering Locally Run Language Models: Share Your Favorites/Not So Favorites!
Let's talk about our experiences working with different models, either known or lesser-known.
Which locally run language models have you tried out? Share your insights, challenges, or anything you found interesting during your encounters with those models.
I've been doing RP with Wizard-Vicuna 13b Uncensored. it's good, very fast (ggml v3 q5-k-s variant) But sometimes forgets it's roleplaying and spits out a story