this post was submitted on 23 Dec 2025
610 points (97.7% liked)

Technology

77899 readers
2395 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
610
AI-generated code contains more bugs and errors than human output (www.techradar.com)
submitted 21 hours ago by throws_lemy@reddthat.com to c/technology@lemmy.world
140 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] Kolanaki@pawb.social 25 points 19 hours ago* (last edited 19 hours ago) (4 children)

It can't even copy and paste a Hello World example properly. If someone says it's working well for them, I'm going to now assume they are too ignorant to understand what's broken.

[–] user224@lemmy.sdf.org 6 points 16 hours ago (1 children)

It works well for recalling something you already know, whether it be computer or human language. What's a word for... what's a command/function that does...

[–] frongt@lemmy.zip 7 points 16 hours ago (1 children)

For words, it's pretty good. For code, it often invents a reasonable-sounding function or model name that doesn't exist.

[–] Xenny@lemmy.world 2 points 6 hours ago* (last edited 6 hours ago) (1 children)

It's not even good for words. AI just writes the same stories over and over and over and over and over and over. It's the same problem as coding. It can't think of anything novel. Hell it can't even think. I'd argue the best and only real use for an llm is to help be a rough draft editor and correct punctuation and grammar. We've gone way way way too far with the scope of what it's actually capable of

[–] Flisty@mstdn.social 1 points 6 hours ago

@Xenny @frongt it's definitely not good for words with any technical meaning, because it creates references to journal articles and legal precedents that sound plausible but don't exist.
Ultimately it's a *very* expensive replacement for the lorem ipsum generator keyboard shortcut.

[–] ptu@sopuli.xyz 5 points 18 hours ago

I use it for things that are simple and monotonous to write. This way I’m able to deliver results to tasks I couldn’t have been arsed to do. I’m a data analyst and mostly use mysql and power query

[–] dogdeanafternoon@lemmy.ca 3 points 17 hours ago (1 children)

What’s your preferred Hello world language? I’m gunna test this out. The more complex the code you need, the more they suck, but I’ll be amazed if it doesn’t work first try to simply print hello world.

[–] xthexder@l.sw0.com 9 points 16 hours ago* (last edited 16 hours ago) (1 children)

Malbolge is a fun one

Edit: Funny enough, ChatGPT fails to get this right, even with the answer right there on Wikipedia. When I tried running ChatGPT's output the first few characters were correct but it errors with invalid char at 37

[–] dogdeanafternoon@lemmy.ca 2 points 16 hours ago (2 children)

Cheeky, I love it.

Got correct code first try. Failed creating working docker first try. Second try worked.

tmp="$(mktemp)"; cat >"$tmp" <<'MBEOF'
('&%:9]!~}|z2Vxwv-,POqponl$Hjig%eB@@>}=<M:9wv6WsU2T|nm-,jcL(I&%$#"
`CB]V?Tx<uVtT`Rpo3NlF.Jh++FdbCBA@?]!~|4XzyTT43Qsqq(Lnmkj"Fhg${z@>
MBEOF
docker run --rm -v "$tmp":/code/hello.mb:ro esolang/malbolge malbolge /code/hello.mb; rm "$tmp"

Output: Hello World!

[–] xthexder@l.sw0.com 5 points 15 hours ago* (last edited 14 hours ago) (1 children)

I'm actually slightly impressed it got both a working program, and a different one than Wikipedia. The Wikipedia one prints "Hello, world."

I guess there must be another program floating around the web with "Hello World!", since there's no chance the LLM figured it out on its own (it kinda requires specialized algorithms to do anything)

[–] dogdeanafternoon@lemmy.ca 1 points 15 hours ago

I’d never even heard of that language, so it was fun to play with.

Definitely agree that the LLM didn’t actually figure anything out, but at least it’s not completely useless

[–] NotMyOldRedditName@lemmy.world 3 points 12 hours ago

Why the fuck does this language exist lol

[–] Serinus@lemmy.world 2 points 10 hours ago

It works well when you use it for small (or repetitive) and explicit tasks. That you can easily check.