this post was submitted on 17 Mar 2025
386 points (96.0% liked)

Technology

66783 readers
4636 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Half of LLM users (49%) think the models they use are smarter than they are, including 26% who think their LLMs are “a lot smarter.” Another 18% think LLMs are as smart as they are. Here are some of the other attributes they see:

  • Confident: 57% say the main LLM they use seems to act in a confident way.
  • Reasoning: 39% say the main LLM they use shows the capacity to think and reason at least some of the time.
  • Sense of humor: 32% say their main LLM seems to have a sense of humor.
  • Morals: 25% say their main model acts like it makes moral judgments about right and wrong at least sometimes. Sarcasm: 17% say their prime LLM seems to respond sarcastically.
  • Sad: 11% say the main model they use seems to express sadness, while 24% say that model also expresses hope.
top 50 comments
sorted by: hot top controversial new old
[–] futatorius@lemm.ee 13 points 51 minutes ago (2 children)

Half of all voters voted for Trump. So an LLM might be smarter than them. Even a bag of pea gravel might be.

[–] Psythik@lemm.ee 1 points 6 minutes ago

Less than a third of all voters voted for Trump. Most voters stayed home.

[–] Viskio_Neta_Kafo@lemm.ee 1 points 42 minutes ago

A bag of frozen peas's is smarter than some of these Trump followers. Even half a frozen pea is.

And you know what? The people who believe that are right.

Note that that’s not a commentary on the capabilities of LLMs.

[–] cmhe@lemmy.world 1 points 25 minutes ago

I suppose some of that comes down to the personal understanding of what "smart" is.

I guess you could call some person, that doesn't understand a topic, but still manages to sound reasonable when talking about it, and might even convince people that they actually have a deep understanding of that topic, "smart", in a kind of "smart imposter".

[–] KingThrillgore@lemmy.ml 17 points 2 hours ago

The average literacy level is around that of a sixth grader.

This tracks

[–] tvbusy@lemmy.dbzer0.com 9 points 2 hours ago

LLM is proof that even if you're extremely stupid, having access to information can still make you sound smart.

[–] Feathercrown@lemmy.world 12 points 2 hours ago

I believe LLMs are smarter than half of US adults

[–] DarrinBrunner@lemmy.world 2 points 1 hour ago

Intelligence and knowledge are two different things. Or, rather, the difference between smart and stupid people is how they interpret the knowledge they acquire. Both can acquire knowledge, but stupid people come to wrong conclusions by misinterpreting the knowledge. Like LLMs, 40% of the time, apparently.

[–] MrAlternateTape@lemm.ee 18 points 4 hours ago (1 children)

That is the problem with US adults. Half of them probably is dumber than AI.....

[–] Flocklesscrow@lemm.ee 9 points 2 hours ago

The grammatical error here is chef's kiss.

[–] tad_lispy@lemm.ee 16 points 5 hours ago

If we are talking about American adults, I guess they might be right.

[–] rottingleaf@lemmy.world 12 points 5 hours ago

That's called a self-proving statement.

[–] Naevermix@lemmy.world 10 points 5 hours ago

Hallucination comes off as confidence. Very human like behavior tbh.

[–] Grizzlyboy@lemm.ee 33 points 8 hours ago (1 children)

It’s like asking if you think a calculator is smarter than you.

[–] Dayroom7485@lemmy.world 16 points 8 hours ago (1 children)

„It‘s totally a lot smarter than I am, no way could I deliver (234 * 534)^21 as confidently!“

[–] stochastic_parrot@sh.itjust.works 7 points 6 hours ago (1 children)

Are you suggesting my 90's calculator is smarter than LLM's?

[–] Dayroom7485@lemmy.world 9 points 6 hours ago

Hard to compete with that 90s confidence 😎

[–] jh29a@lemmy.blahaj.zone 7 points 5 hours ago

Do the other half believe it is dumber than it actually is?

[–] JackFrostNCola@lemmy.world 29 points 8 hours ago

"Half of LLM users " beleive this. Which is not to say that people who understand how flawed LLMs are, or what their actual function is, do not use LLMs and therefore arent i cluded in this statistic?
This is kinda like saying '60% of people who pay for their daily horoscope beleive it is an accurate prediction'.

[–] blady_blah@lemmy.world 13 points 8 hours ago (2 children)

You say this like this is wrong.

Think of a question that you would ask an average person and then think of what the LLM would respond with. The vast majority of the time the llm would be more correct than most people.

[–] JacksonLamb@lemmy.world 6 points 6 hours ago (1 children)

Memory isn't intelligence.

[–] blady_blah@lemmy.world 1 points 2 hours ago

Then asking it a logic question. What question are you asking that the llms are getting wrong and your average person is getting right? How are you proving intelligence here?

[–] LifeInMultipleChoice@lemmy.dbzer0.com 15 points 8 hours ago (1 children)

A good example is the post on here about tax brackets. Far more Republicans didn't know how tax brackets worked than Democrats. But every mainstream language model would have gotten the answer right.

[–] smeenz@lemmy.nz 3 points 4 hours ago* (last edited 4 hours ago)

I bet the LLMs also know who pays tarrifs

[–] MITM0@lemmy.world 3 points 6 hours ago

Why are you even surprised at this point, when it comes to Americans ?

[–] Akuchimoya@startrek.website 24 points 11 hours ago* (last edited 4 hours ago) (2 children)

I had to tell a bunch of librarians that LLMs are literally language models made to mimic language patterns, and are not made to be factually correct. They understood it when I put it that way, but librarians are supposed to be "information professionals". If they, as a slightly better trained subset of the general public, don't know that, the general public has no hope of knowing that.

[–] Arkouda@lemmy.ca 1 points 36 minutes ago

Librarians went to school to learn how to keep order in a library. That does not inherently make them have more information in their heads than the average person, especially regarding things that aren't books and book organization.

[–] WagyuSneakers@lemm.ee 22 points 11 hours ago (1 children)

It's so weird watching the masses ignore industry experts and jump on weird media hype trains. This must be how doctors felt in Covid.

[–] Llewellyn@lemm.ee 4 points 5 hours ago

It's so weird watching the masses ignore industry experts and jump on weird media hype trains.

Is it though?

[–] fubarx@lemmy.world 47 points 15 hours ago

“Think of how stupid the average person is, and realize half of them are stupider than that.” ― George Carlin

[–] aesthelete@lemmy.world 12 points 12 hours ago

They're right

[–] notsoshaihulud@lemmy.world 35 points 15 hours ago (1 children)

I'm 100% certain that LLMs are smarter than half of Americans. What I'm not so sure about is that the people with the insight to admit being dumber than an LLM are the ones who really are.

load more comments (1 replies)
[–] Comtief@lemm.ee 16 points 15 hours ago (3 children)

LLMs are smart in the way someone is smart who has read all the books and knows all of them but has never left the house. Basically all theory and no street smarts.

[–] joel_feila@lemmy.world 7 points 6 hours ago (1 children)

Bot even that smart. There a study recently that simple questiona like "what was huckleberry finn first published" had a 60% error rate.

[–] Comtief@lemm.ee 2 points 5 hours ago

yeah my analogy is not so good.. LLMs suck with factual stuff, they are better with coding or languages (Claude has been really helpful to me with Estonian).

[–] ripcord@lemmy.world 24 points 15 hours ago (1 children)

They're not even that smart.

load more comments (1 replies)
load more comments (1 replies)
[–] Kolanaki@pawb.social 33 points 18 hours ago* (last edited 18 hours ago)

They're right. AI is smarter than them.

[–] kromem@lemmy.world 0 points 6 hours ago (1 children)

Wow. Reading these comments so many people here really don't understand how LLMs work or what's actually going on at the frontier of the field.

I feel like there's going to be a cultural sonic boom, where when the shockwave finally catches up people are going to be woefully under prepared based on what they think they saw.

[–] explodicle@sh.itjust.works 1 points 1 hour ago

AKA "future shock"

load more comments
view more: next ›