I find Qwen3.5 is the best at toolcalling and agent use, otherwise Gemma4 is a very solid all-rounder and it should be the first you try. Tbh gpt-oss is still good to this day, are you running into any problems w it?
this post was submitted on 11 Apr 2026
66 points (83.0% liked)
Selfhosted
59179 readers
402 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
-
No low-effort posts. This is subjective and will largely be determined by the community member reports.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 2 years ago
MODERATORS
No problems per se. I just thought that I had not checked for an update for a longer time.
You're probably aware, but updating the model periodically is probably a good idea just because things do change overtime.
A model from two years ago was trained on data from at least two years ago. Meaning any technology, code, world event changes wouldn't be reflected in the model.
I suggest looking at llm arena leaderboards filtered by open weight models. It offers benchmarks at a very complete and statistically detailed level for models, and usually is quite up to date when new models come out. The new Gemma that just came out might be the best for 1x GPU, and if you have a bunch of vram check out the larger Chinese models
I'd say Qwen 3.5 and Gemma 4 beat GPT OSS in every aspect.
I also recommend gemma4 or qwen3.5. Both super solid in my experience for how lightweight they are
Still can't get my gemma to give me complete unbuggy components
I guess I have been using gemma4 fro more role playing games. Qwen3.5 seems to be better coder actually
I'm not on there, but you might have more luck in !localllama@sh.itjust.works
You might also want to list the hardware that you plan to use, since that'll constrain what you can reasonably run.
The latest open weights model from google might be a good fit for you. The 26B model works pretty well on my machine, though the performance isn't great (6 tokens per second, CPU only).
Gemma4 e4b quant8 will fit in 12gb and is good
I'm running gemma4 26b MOE for most of my agent calls. I use glm5:cloud for my development agent because 26b struggles when the context windows gets too big.
Qwen is pretty good. Also try LFM models.
I'm in the same boat. You'll get better responses if you post your machine specs. I
I’d use some Chinese model. Qwen3.5 Claude 4.6 distilled ablitirated is what I use
What are your computer specs?
I did just update my post with the specs. Maybe it takes a while to federate?
I must have not refreshed ignore my comment
Have you tried the new gemma4 models? The e4b fits in the 12gb memory and is pretty good. Or you can use 31b too, if you're okay with offloading to CPU.
Just curious, what does "some automation" entail? I thought LLMs could only work with text, like summarize documents and that sort of thing.
It's done by software using an LLM, not just a raw LLM. They do only work with text, but you can get it to output the text "get_weather(mylocation)", and instead of just outputting that directly to the user, the software running on top of the LLM runs a " get_weather" function that calls some weather API. The result of that function is then output to the user.
Any time you see an "AI" taking "actions", this is what happens in the background for every action.
These days they can also chain together tools, keep a working memory etc. Look at Claude Code if you're curious. It's come very far very quickly in the last 12 months.
OP said coding AND "some automation", what is being automated?
How much VRAM?