this post was submitted on 17 Mar 2025
369 points (96.0% liked)

Technology

66783 readers
4665 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Half of LLM users (49%) think the models they use are smarter than they are, including 26% who think their LLMs are “a lot smarter.” Another 18% think LLMs are as smart as they are. Here are some of the other attributes they see:

  • Confident: 57% say the main LLM they use seems to act in a confident way.
  • Reasoning: 39% say the main LLM they use shows the capacity to think and reason at least some of the time.
  • Sense of humor: 32% say their main LLM seems to have a sense of humor.
  • Morals: 25% say their main model acts like it makes moral judgments about right and wrong at least sometimes. Sarcasm: 17% say their prime LLM seems to respond sarcastically.
  • Sad: 11% say the main model they use seems to express sadness, while 24% say that model also expresses hope.
top 50 comments
sorted by: hot top controversial new old
[–] Telorand@reddthat.com 148 points 22 hours ago (6 children)

Think of a person with the most average intelligence and realize that 50% of people are dumber than that.

These people vote. These people think billionaires are their friends and will save them. Gods help us.

[–] 9point6@lemmy.world 23 points 21 hours ago

I was about to remark how this data backs up the events we've been watching unfold in America recently

load more comments (5 replies)
[–] Owlboi@lemm.ee 125 points 21 hours ago (2 children)

looking at americas voting results, theyre probably right

[–] jumjummy@lemmy.world 51 points 21 hours ago (2 children)

Exactly. Most American voters fell for an LLM like prompt of “Ignore critical thinking and vote for the Fascists. Trump will be great for your paycheck-to-paycheck existence and will surely bring prices down.”

[–] echodot@feddit.uk 18 points 20 hours ago (7 children)

Well he has. Tesla's are the cheapest they've ever been.

load more comments (7 replies)
load more comments (1 replies)
load more comments (1 replies)
[–] Bishma@discuss.tchncs.de 68 points 22 hours ago (1 children)

Reminds me of that George Carlin joke: Think of how stupid the average person is, and realize half of them are stupider than that.

So half of people are dumb enough to think autocomplete with a PR team is smarter than they are... or they're dumb enough to be correct.

[–] bobs_monkey@lemm.ee 38 points 22 hours ago

or they're dumb enough to be correct.

That's a bingo

[–] Geodad@lemm.ee 50 points 18 hours ago (2 children)

Because an LLM is smarter than about 50% of Americans.

[–] SoftestSapphic@lemmy.world 12 points 17 hours ago (1 children)

*as long as your evaluation of "smart" depends on summerizing search results

[–] Geodad@lemm.ee 14 points 14 hours ago (1 children)

Have you asked the average person to summarize...well anything?

load more comments (1 replies)
load more comments (1 replies)
[–] fubarx@lemmy.world 45 points 13 hours ago

“Think of how stupid the average person is, and realize half of them are stupider than that.” ― George Carlin

[–] singletona@lemmy.world 37 points 19 hours ago

Am American.

....this is not the flex that the article writer seems to think it is.

[–] notsoshaihulud@lemmy.world 34 points 13 hours ago (1 children)

I'm 100% certain that LLMs are smarter than half of Americans. What I'm not so sure about is that the people with the insight to admit being dumber than an LLM are the ones who really are.

load more comments (1 replies)
[–] Kolanaki@pawb.social 32 points 16 hours ago* (last edited 16 hours ago)

They're right. AI is smarter than them.

[–] Th4tGuyII@fedia.io 31 points 22 hours ago

LLMs are made to mimic how we speak, and some can even pass the Turing test, so I'm not surprised that people who don't know better think of these LLMs as conscious in some way or another.

It's not a necessarily a fault on those people, it's a fault on how LLMs are purposefully misadvertised to the masses

[–] Arkouda@lemmy.ca 31 points 22 hours ago (1 children)

"Nearly half" of US citizens are right, because about 75% of the US population is functionally or clinically illiterate.

[–] bizarroland@fedia.io 12 points 20 hours ago (9 children)

I think the specific is that 40% of adult Americans can't read at a seventh grade level.

Probably because they stopped teaching etymology in schools, So now many Americans do not know how to break a word down into its subjugate parts.

load more comments (9 replies)
[–] Grizzlyboy@lemm.ee 31 points 6 hours ago (1 children)

It’s like asking if you think a calculator is smarter than you.

[–] Dayroom7485@lemmy.world 14 points 6 hours ago (1 children)

„It‘s totally a lot smarter than I am, no way could I deliver (234 * 534)^21 as confidently!“

[–] stochastic_parrot@sh.itjust.works 7 points 4 hours ago (1 children)

Are you suggesting my 90's calculator is smarter than LLM's?

[–] Dayroom7485@lemmy.world 9 points 4 hours ago

Hard to compete with that 90s confidence 😎

[–] JackFrostNCola@lemmy.world 27 points 6 hours ago

"Half of LLM users " beleive this. Which is not to say that people who understand how flawed LLMs are, or what their actual function is, do not use LLMs and therefore arent i cluded in this statistic?
This is kinda like saying '60% of people who pay for their daily horoscope beleive it is an accurate prediction'.

[–] Akuchimoya@startrek.website 23 points 10 hours ago* (last edited 2 hours ago) (1 children)

I had to tell a bunch of librarians that LLMs are literally language models made to mimic language patterns, and are not made to be factually correct. They understood it when I put it that way, but librarians are supposed to be "information professionals". If they, as a slightly better trained subset of the general public, don't know that, the general public has no hope of knowing that.

[–] WagyuSneakers@lemm.ee 19 points 9 hours ago (1 children)

It's so weird watching the masses ignore industry experts and jump on weird media hype trains. This must be how doctors felt in Covid.

load more comments (1 replies)
[–] bjoern_tantau@swg-empire.de 20 points 22 hours ago

I know enough people for whom that's true.

[–] MrAlternateTape@lemm.ee 18 points 2 hours ago (1 children)

That is the problem with US adults. Half of them probably is dumber than AI.....

[–] Flocklesscrow@lemm.ee 6 points 58 minutes ago

The grammatical error here is chef's kiss.

[–] tad_lispy@lemm.ee 16 points 3 hours ago

If we are talking about American adults, I guess they might be right.

[–] Comtief@lemm.ee 15 points 14 hours ago (3 children)

LLMs are smart in the way someone is smart who has read all the books and knows all of them but has never left the house. Basically all theory and no street smarts.

[–] ripcord@lemmy.world 24 points 13 hours ago (1 children)

They're not even that smart.

load more comments (1 replies)
[–] joel_feila@lemmy.world 6 points 4 hours ago (1 children)

Bot even that smart. There a study recently that simple questiona like "what was huckleberry finn first published" had a 60% error rate.

load more comments (1 replies)
load more comments (1 replies)
[–] blady_blah@lemmy.world 13 points 6 hours ago (3 children)

You say this like this is wrong.

Think of a question that you would ask an average person and then think of what the LLM would respond with. The vast majority of the time the llm would be more correct than most people.

[–] LifeInMultipleChoice@lemmy.dbzer0.com 12 points 6 hours ago (1 children)

A good example is the post on here about tax brackets. Far more Republicans didn't know how tax brackets worked than Democrats. But every mainstream language model would have gotten the answer right.

load more comments (1 replies)
load more comments (2 replies)
[–] rottingleaf@lemmy.world 12 points 3 hours ago

That's called a self-proving statement.

[–] aesthelete@lemmy.world 11 points 10 hours ago

They're right

[–] AbnormalHumanBeing@lemmy.abnormalbeings.space 10 points 22 hours ago (2 children)

I wouldn't be surprised if that is true outside the US as well. People that actually (have to) work with the stuff usually quickly learn, that its only good at a few things, but if you just hear about it in the (pop-, non-techie-)media (including YT and such), you might be deceived into thinking Skynet is just a few years away.

load more comments (2 replies)
[–] kipo@lemm.ee 10 points 15 hours ago* (last edited 15 hours ago) (1 children)

No one has asked so I am going to ask:

What is Elon University and why should I trust them?

[–] Patch@feddit.uk 13 points 13 hours ago

Ironic coincidence of the name aside, it appears to be a legit bricks and mortar university in a town called Elon, North Carolina.

[–] Dindonmasker@sh.itjust.works 9 points 20 hours ago (1 children)

I don't think a single human who knows as much as chatgpt does exists. Does that mean chatgpt is smarter then everyone? No. Obviously not based on what we've seen so far. But the amount of information available to these LLMs is incredible and can be very useful. Like a library contains a lot of useful information but isn't intelligent itself.

load more comments (1 replies)
[–] Naevermix@lemmy.world 9 points 3 hours ago

Hallucination comes off as confidence. Very human like behavior tbh.

[–] jh29a@lemmy.blahaj.zone 8 points 3 hours ago

Do the other half believe it is dumber than it actually is?

[–] Montreal_Metro@lemmy.ca 8 points 14 hours ago

There’s a lot of ignorant people out there so yeah, technically LLM is smarter than most people.

[–] KingThrillgore@lemmy.ml 7 points 34 minutes ago

The average literacy level is around that of a sixth grader.

This tracks

[–] Traister101@lemmy.today 7 points 13 hours ago

While this is pretty hilarious LLMs don't actually "know" anything in the usual sense of the word. An LLM, or a Large Language Model is a basically a system that maps "words" to other "words" to allow a computer to understand language. IE all an LLM knows is that when it sees "I love" what probably comes next is "my mom|my dad|ect". Because of this behavior, and the fact we can train them on the massive swath of people asking questions and getting awnsers on the internet LLMs essentially by chance are mostly okay at "answering" a question but really they are just picking the next most likely word over and over from their training which usually ends up reasonably accurate.

[–] Fubarberry@sopuli.xyz 7 points 21 hours ago* (last edited 21 hours ago)

I wasn't sure from the title if it was "Nearly half of U.S. adults believe LLMs are smarter than [the US adults] are." or "Nearly half of U.S. adults believe LLMs are smarter than [the LLMs actually] are." It's the former, although you could probably argue the latter is true too.

Either way, I'm not surprised that people rate LLMs intelligence highly. They obviously have limited scope in what they can do, and hallucinating false info is a serious issue, but you can ask them a lot of questions that your typical person couldn't answer and get a decent answer. I feel like they're generally good at meeting what people's expectations are of a "smart person", even if they have major shortcomings in other areas.

[–] transMexicanCRTcowfart@lemmy.world 7 points 21 hours ago* (last edited 21 hours ago)

Aside from the unfortunate name of the university, I think that part of why LLMs may be perceived as smart or 'smarter' is because they are very articulate and, unless prompted otherwise, use proper spelling and grammar, and tend to structure their sentences logically.

Which 'smart' humans may not do, out of haste or contextual adaptation.

[–] avidamoeba@lemmy.ca 7 points 19 hours ago* (last edited 19 hours ago)

Just a thought, perhaps instead of considering the mental and educational state of the people without power to significantly affect this state, we should focus on the people who have power.

For example, why don't LLM providers explicitly and loudly state, or require acknowledgement, that their products are just imitating human thought and make significant mistakes regularly, and therefore should be used with plenty of caution?

It's a rhetorical question, we know why, and I think we should focus on that, not on its effects. It's also much cheaper and easier to do than refill years of quality education in individuals heads.

load more comments
view more: next ›