294
I Asked AI to Count My Carbs 27,000 Times. It Couldn’t Give Me the Same Answer Twice.
(www.diabettech.com)
This is a most excellent place for technology news and articles.
The fact that it uses a non-trivial neural network. If it was simply a rate count of based on a corpus of how much time each word is followed by each it wouldn't be stronger than keyboard word predictions. To make accurate suggestions requires emergence of primitive reasoning on the semantics of the tokens, LLM neural networks (transformers) can be analyzed to find subnetworks dedicated to modeling reality. It is still probability, but saying it's just probability is not faithful
It's still just predicting the next token, it's just using more past data points than your keyboard. The rest of the phenomena are emergent from that. I think it's important to keep that in mind given how much they can imitate human reasoning.
If you recognize there's emergence, the "it's just probability" take is misleading