this post was submitted on 17 Mar 2025
533 points (96.8% liked)

Technology

66783 readers
4850 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Half of LLM users (49%) think the models they use are smarter than they are, including 26% who think their LLMs are “a lot smarter.” Another 18% think LLMs are as smart as they are. Here are some of the other attributes they see:

  • Confident: 57% say the main LLM they use seems to act in a confident way.
  • Reasoning: 39% say the main LLM they use shows the capacity to think and reason at least some of the time.
  • Sense of humor: 32% say their main LLM seems to have a sense of humor.
  • Morals: 25% say their main model acts like it makes moral judgments about right and wrong at least sometimes. Sarcasm: 17% say their prime LLM seems to respond sarcastically.
  • Sad: 11% say the main model they use seems to express sadness, while 24% say that model also expresses hope.
(page 3) 50 comments
sorted by: hot top controversial new old
[–] jh29a@lemmy.blahaj.zone 7 points 18 hours ago

Do the other half believe it is dumber than it actually is?

[–] blady_blah@lemmy.world 14 points 21 hours ago (2 children)

You say this like this is wrong.

Think of a question that you would ask an average person and then think of what the LLM would respond with. The vast majority of the time the llm would be more correct than most people.

[–] LifeInMultipleChoice@lemmy.dbzer0.com 17 points 21 hours ago (1 children)

A good example is the post on here about tax brackets. Far more Republicans didn't know how tax brackets worked than Democrats. But every mainstream language model would have gotten the answer right.

[–] smeenz@lemmy.nz 6 points 16 hours ago* (last edited 16 hours ago)

I bet the LLMs also know who pays tarrifs

[–] JacksonLamb@lemmy.world 8 points 18 hours ago (9 children)

Memory isn't intelligence.

load more comments (9 replies)
[–] Akuchimoya@startrek.website 26 points 1 day ago* (last edited 17 hours ago) (3 children)

I had to tell a bunch of librarians that LLMs are literally language models made to mimic language patterns, and are not made to be factually correct. They understood it when I put it that way, but librarians are supposed to be "information professionals". If they, as a slightly better trained subset of the general public, don't know that, the general public has no hope of knowing that.

[–] Arkouda@lemmy.ca 2 points 12 hours ago (1 children)

Librarians went to school to learn how to keep order in a library. That does not inherently make them have more information in their heads than the average person, especially regarding things that aren't books and book organization.

load more comments (1 replies)
[–] WagyuSneakers@lemm.ee 23 points 1 day ago (1 children)

It's so weird watching the masses ignore industry experts and jump on weird media hype trains. This must be how doctors felt in Covid.

[–] Llewellyn@lemm.ee 4 points 17 hours ago (3 children)

It's so weird watching the masses ignore industry experts and jump on weird media hype trains.

Is it though?

load more comments (3 replies)
load more comments (1 replies)
[–] fubarx@lemmy.world 50 points 1 day ago

“Think of how stupid the average person is, and realize half of them are stupider than that.” ― George Carlin

[–] cmhe@lemmy.world 1 points 12 hours ago

I suppose some of that comes down to the personal understanding of what "smart" is.

I guess you could call some person, that doesn't understand a topic, but still manages to sound reasonable when talking about it, and might even convince people that they actually have a deep understanding of that topic, "smart", in a kind of "smart imposter".

[–] notsoshaihulud@lemmy.world 38 points 1 day ago (1 children)

I'm 100% certain that LLMs are smarter than half of Americans. What I'm not so sure about is that the people with the insight to admit being dumber than an LLM are the ones who really are.

[–] And009@lemmynsfw.com 5 points 1 day ago

A daily bite of horror.

[–] aesthelete@lemmy.world 13 points 1 day ago

They're right

[–] Telorand@reddthat.com 177 points 1 day ago (6 children)

Think of a person with the most average intelligence and realize that 50% of people are dumber than that.

These people vote. These people think billionaires are their friends and will save them. Gods help us.

[–] Gigasser@lemmy.world 13 points 20 hours ago (2 children)

I'm of the opinion that most people aren't dumb, but rather most don't put in the requisite intellectual effort to actually reach accurate or precise or nuanced positions and opinions. Like they have the capacity to do so! They're humans after all, and us humans can be pretty smart. But a brain accustomed to simply taking the path of least resistance is gonna continue to do so until it is forced(hopefully through their own action) to actually do something harder.

Put succinctly: They can think, yet they don't.

[–] JustEnoughDucks@feddit.nl 7 points 18 hours ago (2 children)

Then the question is: what is being smart or dumb? If acting dumb in 90% of life while having the capability of being smart isn't "being dumb" then what is?

If someone who has the capability of being 50/100 intelligent and is always acting 50/100, I would argue they are smarter than someone capable of 80/100 intelligence but acts 20/100 intelligence for 90% of their life.

[–] Gigasser@lemmy.world 2 points 16 hours ago* (last edited 15 hours ago)

Basically, although base intelligence/smartness perhaps has two parameters that make it? Effort and speed. Everyone can put in a bit more effort, but base speed may be baked in, unless one trains it, and max reachable base speed will depend from person to person. Hell if I know, we haven't really created a definitive definition for intelligence yet.

Edit Addendum: As for what can be considered dumb or smart? I agree, lack of effort can be considered "dumb". Though the word dumb is a bit broad. I guess we can say many people are, out of habit, "intellectually heedless"

load more comments (1 replies)
load more comments (1 replies)
[–] 9point6@lemmy.world 30 points 1 day ago

I was about to remark how this data backs up the events we've been watching unfold in America recently

load more comments (4 replies)
[–] Owlboi@lemm.ee 138 points 1 day ago (2 children)

looking at americas voting results, theyre probably right

[–] jumjummy@lemmy.world 56 points 1 day ago (9 children)

Exactly. Most American voters fell for an LLM like prompt of “Ignore critical thinking and vote for the Fascists. Trump will be great for your paycheck-to-paycheck existence and will surely bring prices down.”

[–] thegr8goldfish@startrek.website 5 points 23 hours ago

Spout nonsense with enough confidence and you can wield unimaginable power. Am I talking about LLMs or president poopy pants?

load more comments (8 replies)
load more comments (1 replies)
[–] Retropunk64@lemmy.world 0 points 10 hours ago (1 children)
load more comments (1 replies)
[–] Geodad@lemm.ee 51 points 1 day ago (2 children)

Because an LLM is smarter than about 50% of Americans.

[–] SoftestSapphic@lemmy.world 15 points 1 day ago (1 children)

*as long as your evaluation of "smart" depends on summerizing search results

[–] Geodad@lemm.ee 18 points 1 day ago (3 children)

Have you asked the average person to summarize...well anything?

load more comments (3 replies)
load more comments (1 replies)
[–] Kolanaki@pawb.social 34 points 1 day ago* (last edited 1 day ago)

They're right. AI is smarter than them.

[–] Comtief@lemm.ee 17 points 1 day ago (3 children)

LLMs are smart in the way someone is smart who has read all the books and knows all of them but has never left the house. Basically all theory and no street smarts.

[–] joel_feila@lemmy.world 8 points 18 hours ago (1 children)

Bot even that smart. There a study recently that simple questiona like "what was huckleberry finn first published" had a 60% error rate.

[–] Comtief@lemm.ee 2 points 18 hours ago

yeah my analogy is not so good.. LLMs suck with factual stuff, they are better with coding or languages (Claude has been really helpful to me with Estonian).

[–] ripcord@lemmy.world 26 points 1 day ago (1 children)

They're not even that smart.

load more comments (1 replies)
load more comments (1 replies)
[–] Bishma@discuss.tchncs.de 75 points 1 day ago (1 children)

Reminds me of that George Carlin joke: Think of how stupid the average person is, and realize half of them are stupider than that.

So half of people are dumb enough to think autocomplete with a PR team is smarter than they are... or they're dumb enough to be correct.

[–] bobs_monkey@lemm.ee 41 points 1 day ago

or they're dumb enough to be correct.

That's a bingo

[–] singletona@lemmy.world 40 points 1 day ago

Am American.

....this is not the flex that the article writer seems to think it is.

[–] MITM0@lemmy.world 2 points 18 hours ago

Why are you even surprised at this point, when it comes to Americans ?

[–] kipo@lemm.ee 12 points 1 day ago* (last edited 1 day ago) (1 children)

No one has asked so I am going to ask:

What is Elon University and why should I trust them?

[–] Patch@feddit.uk 15 points 1 day ago

Ironic coincidence of the name aside, it appears to be a legit bricks and mortar university in a town called Elon, North Carolina.

[–] Traister101@lemmy.today 8 points 1 day ago

While this is pretty hilarious LLMs don't actually "know" anything in the usual sense of the word. An LLM, or a Large Language Model is a basically a system that maps "words" to other "words" to allow a computer to understand language. IE all an LLM knows is that when it sees "I love" what probably comes next is "my mom|my dad|ect". Because of this behavior, and the fact we can train them on the massive swath of people asking questions and getting awnsers on the internet LLMs essentially by chance are mostly okay at "answering" a question but really they are just picking the next most likely word over and over from their training which usually ends up reasonably accurate.

[–] Th4tGuyII@fedia.io 33 points 1 day ago

LLMs are made to mimic how we speak, and some can even pass the Turing test, so I'm not surprised that people who don't know better think of these LLMs as conscious in some way or another.

It's not a necessarily a fault on those people, it's a fault on how LLMs are purposefully misadvertised to the masses

[–] Arkouda@lemmy.ca 32 points 1 day ago (13 children)

"Nearly half" of US citizens are right, because about 75% of the US population is functionally or clinically illiterate.

load more comments (13 replies)
load more comments
view more: ‹ prev next ›