this post was submitted on 12 Apr 2026
685 points (95.0% liked)

Technology

83963 readers
4414 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
685
Linux lays down the law on AI-generated code, says yes to Copilot, no to AI slop, and humans take the fall for mistakes — after months of fierce debate, Torvalds and maintainers come to an agreement (www.tomshardware.com)
submitted 1 week ago by throws_lemy@lemmy.nz to c/technology@lemmy.world
299 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] Feyd@programming.dev -3 points 1 week ago* (last edited 1 week ago) (1 children)

You can, at that will cause the same output on the same input if there is no variation in floating point rounding errors. (True if the same code is running but easy when optimizing to hit a round up/down and if the tokens are very close the output will diverge)

There are more aspects to the randomness such as race conditions and intentionally nondeterministic tiebreaking when tokens have the same probability, apparently.

I actually think LLMs are ill suited for the vast majority of things people are currently using them for, and there are obviously the ethical problems with data centers bringing new fossil fuel power sources online, but the technology is interesting in and of itself

[–] GreenBeanMachine@lemmy.world 4 points 1 week ago* (last edited 1 week ago) (1 children)

There are more aspects to the randomness such as race conditions and intentionally nondeterministic tiebreaking when tokens have the same probability, apparently.

Yeah, in addition to what the commenter above said about floating points and GPU calculations, LLMs are never fully deterministic.

So now you finally admit that LLMs are not truly deterministic and only near-deterministic.

I've told you that from the beginning, but you were too smug, to first admit that major LLM provider systems are not deterministic, and then too smug to look up what near-deterministic systems are and do some research, and barking up the wrong tree.

[–] Feyd@programming.dev -3 points 1 week ago (1 children)
  1. Floating point math is deterministic.
  2. Systems don't have to be programmed with race conditions. That is not a fundamental aspect of an LLM, but a design decision.
  3. Systems don't have to be programmed to tie break with random methods. That is not a fundamental aspect of an LLM, but a design decision.

This is not hard stuff to understand, if you understand computing.

[–] GreenBeanMachine@lemmy.world 4 points 1 week ago* (last edited 1 week ago)

And yet, LLMs are not deterministic.

This is not hard stuff to understand, if you understand computing.

LOL, you clearly have no clue how floating points work in computing. What an imposter you are. Go back to your AI for more "computing" advice, Mr. "Software Engineer".

You could at least go and verify if your AI is lying to you.

Even when proven wrong, you still don't give up LMAO 🤣

I'm not gonna bother anymore with you, just talking to a dumb AI here.

Enjoy your "deterministic" AI and good luck in life.