this post was submitted on 23 Feb 2026
707 points (97.3% liked)

Technology

81907 readers
3015 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the 'reasoning' models.

you are viewing a single comment's thread
view the rest of the comments
[–] pupbiru@aussie.zone 1 points 1 day ago (1 children)

yeah i find the thinking fascinating with maths too… like LLMs are horrible at maths but so am i if i have to do it in my head… the way it breaks a problem down into tiny bits that is certainly in its training data, and then combine those bits is an impressive emergent behaviour imo given it’s just doing statistical next token

[–] mirshafie@europe.pub 1 points 1 day ago (1 children)

Your verbal faculties are bad at math. Other parts of your brain do calculations.

LLMs are a computer's verbal faculties. But guess what, they're just a really big calculator. So when LLMs realize that they're doing a math problem and launch a calculator/equation solver, they're not so bad after all.

[–] pupbiru@aussie.zone 2 points 1 day ago (1 children)

that solver would be tool use though… i’m talking about just the “thinking” LLMs. it’s fascinating to read the thinking block, because it breaks the problem down into basic chunks, solves the basic chunks (which it would have been in its training data, so easy), and solves them with multiple methods and then compares to check itself

[–] mirshafie@europe.pub 1 points 12 hours ago

Yeah, I think it's fascinating to read Claude's transcripts while it's working. It's crazy how you can give it a two-sentence prompt that really is quite complex task, and it splits the problems into chunks that it works through and second-guesses until it's confident (and usually correct).