119
I Asked AI to Count My Carbs 27,000 Times. It Couldn’t Give Me the Same Answer Twice.
(www.diabettech.com)
This is a most excellent place for technology news and articles.
Waste of energy. It's like asking a person to estimate a non-trivial angle. Either use a model trained for that task, or don't bother.
The point is they are advertising that these models can do it.
I don't know what ads show that, but anyone who knows the first thing about LLMs knows you don't get the same answer twice.
I'd get this expectation 5 years ago when most people weren't familiar with it, but come on... you don't need to feed it an image 500 times to see that.
Technically, you can get the same answer twice from an LLM, but only when you control the full input. When a model is being run, a random seed/hash is applied to the input. If you run the model locally you could force the seed to always be the same so that you would always get the same answer for a given question.