this post was submitted on 01 May 2026
294 points (94.0% liked)

Technology

85645 readers
3178 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] SlimePirate@lemmy.dbzer0.com -1 points 1 month ago (1 children)

The fact that it uses a non-trivial neural network. If it was simply a rate count of based on a corpus of how much time each word is followed by each it wouldn't be stronger than keyboard word predictions. To make accurate suggestions requires emergence of primitive reasoning on the semantics of the tokens, LLM neural networks (transformers) can be analyzed to find subnetworks dedicated to modeling reality. It is still probability, but saying it's just probability is not faithful

[–] hesh@quokk.au 4 points 1 month ago (1 children)

It's still just predicting the next token, it's just using more past data points than your keyboard. The rest of the phenomena are emergent from that. I think it's important to keep that in mind given how much they can imitate human reasoning.

[–] SlimePirate@lemmy.dbzer0.com -1 points 1 month ago

If you recognize there's emergence, the "it's just probability" take is misleading