this post was submitted on 27 Dec 2024
390 points (97.3% liked)
Technology
60564 readers
5676 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Booooooooooo!
Anyway: ill just keep using alpaca to run llms locally
is there an easy way to do this that doesn't require me to understand how github works?
I think that in that case, YouTube is your friend. There are a few pretty straight forward videos that can help you out; if you're serious about it you're going have to, eventually, become familiar with it.
I recommend Ollama, its easy to setup and the cli can download and run llms. With some more techsavviness you can get openwebui as a nice ui.
https://ollama.com/ https://openwebui.com/
For someone who doesn't understand GitHub, the CLI might be a bit much, FWIW.
It would be nice if there were a GUI, download-and-run single click app with a webui built in.
in that case you're looking for llamafiles. single file, llm included, starts into a web gui. the only limitation is that windows limits the size of executable files to 4GB so on that OS you're limited to smaller models.
That sounds interesting, I'll check it out, thanks!
Alpaca for linux is easy to use. You just install the flatpak and the llm of your choice. You dont need to know how to use github. (It might have a windows version but im not sure)