this post was submitted on 01 Jun 2024
398 points (98.3% liked)
Technology
59589 readers
2910 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Have a look at self hosted alternatives like Ollama in combination with Open-webui. It can be a hassle to set up, or even excruciatingly painful if you never touched a computer before, but it could be worth a try. I use it daily and like it much more than chatgpt to be honest.
is the perfect description
You can literally run large language models with a single exe download: https://github.com/Mozilla-Ocho/llamafile
It doesn't get much simpler than that.
Thanks!
I wish I did. What local model and version of ChatGPT did you compare?
For my purposes, ChatGPT 4 was leagues ahead of the largest model I could run on a 1060.
I like the gemma models bc of the phrasing they use and that they give sources sometimes. The best results though come from llama3 I think. Also openhermes and openchat, which perform well enough for my purposes.
In the beginning i had used microsoft phi, that wasn't that good though.
I will have to give it another shot because I don't recognize any of those models meaning I probably didn't try them.