this post was submitted on 07 Feb 2026
434 points (99.5% liked)

Technology

80795 readers
3580 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
434
Consumer hardware is no longer a priority for manufacturers (www.xda-developers.com)
submitted 1 day ago by throws_lemy@lemmy.nz to c/technology@lemmy.world
109 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] Clam_Cathedral@lemmy.ml 4 points 17 hours ago

Honestly just jump in with whatever hardware you have available and a small 1.5b/7b model. You'll figure out all the difficult uncertainties as you go and try to improve things.

I'm hosting a few lighter models that are somewhat useful and fun without even using a dedicated GPU- just a lot of ram and fast NVMe so the models don't take forever to spin up.

Of course I've got an upgrade path in mind for the hardware and to add a GPU but there are other places I'd rather put the money atm and I do appreciate that it all currently runs on a 250w PSU.