this post was submitted on 24 May 2024
283 points (93.5% liked)

Technology

59534 readers
3197 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Coffeezilla asks: "Is the LAM a Scam? Down the rabbit hole we go."

you are viewing a single comment's thread
view the rest of the comments
[–] gh0stcassette@lemmy.blahaj.zone 33 points 6 months ago (1 children)

This is because dedicated consumer AI hardware is a dumb idea. If it's powerful enough to run a model locally, you should be able to use it for other things (like, say, as a phone or PC) and if it's sending all its API requests to the cloud, then it has no business being anything but a smartphone app or website.

[–] KairuByte@lemmy.dbzer0.com 4 points 5 months ago (1 children)

I can’t agree with that. ASICs can specialize to do one thing at lightning speeds, and fail to do even the most basic of anything else. It’s like claiming your GPU is super powerful so it should be able to run your PC without a CPU.

[–] gh0stcassette@lemmy.blahaj.zone 1 points 5 months ago* (last edited 5 months ago)

That's fair, dedicated ASICs for AI acceleration are totally a valid consumer product, but I meant more along the lines of independent devices (like Rabbit R1 and the AI Pin), not components you can add to an existing device. I should have been more clear.