this post was submitted on 07 Feb 2026
434 points (99.5% liked)

Technology

80795 readers
3580 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
434
Consumer hardware is no longer a priority for manufacturers (www.xda-developers.com)
submitted 1 day ago by throws_lemy@lemmy.nz to c/technology@lemmy.world
109 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] brucethemoose@lemmy.world 5 points 20 hours ago* (last edited 20 hours ago) (1 children)

I did find this calculator the other day

That calculator is total nonsense. Don't trust anything like that; at best, its obsolete the week after its posted.

I’d be hesitant to buy something just for AI that doesn’t also have RTX cores because I do a lot of Blender rendering. RDNA 5 is supposed to have more competitive RTX cores

Yeah, that's a huge caveat. AMD Blender might be better than you think though, and you can use your RTX 4060 on a Strix Halo motherboard just fine. The CPU itself is incredible for any kind of workstation workload.

along with NPU cores, so I guess my ideal would be a SoC with a ton of RAM

So far, NPUs have been useless. Don't buy any of that marketing.

I’m also not sure under 10 tokens per second will be usable, though I’ve never really tried it.

That's still 5 words/second. That's not a bad reading speed.

Whether its enough? That depends. GLM 350B without thinking is smarter than most models with thinking, so I end up with better answers faster.

But anyway, I'm get more like 20 tokens a second with models that aren't squeezed into my rig within an inch of their life. If you buy an HEDT/Server CPU with more RAM channels, it's even faster.

If you want to look into the bleeding edge, start with https://github.com/ikawrakow/ik_llama.cpp/

And all the models on huggingface with the ik tag: https://huggingface.co/models?other=ik_llama.cpp&sort=modified

You'll see instructions for running big models on a 4060 + RAM.

If you're trying to like batch process documents quickly (so no CPU offloading), look at exl3s instead: https://huggingface.co/models?num_parameters=min%3A12B%2Cmax%3A32B&sort=modified&search=exl3

And run them with this: https://github.com/theroyallab/tabbyAPI

[–] melfie@lemy.lol 2 points 20 hours ago

Ah, a lot of good info! Thanks, I’ll look into all of that!