And that's what happens when you spend a trillion dollars on an autocomplete: amazing at making things look like whatever it's imitating, but with zero understanding of why the original looked that way.

[–] CanadaPlus@lemmy.sdf.org -5 points 8 hours ago* (last edited 8 hours ago) (1 children)

I mean, there's about a billion ways it's been shown to have actual coherent originality at this point, and so it must have understanding of some kind. That's how I know I and other humans have understanding, after all.

What it's not is aligned to care about anything other than making plausible-looking text.

[–] Jtotheb@lemmy.world 8 points 7 hours ago (1 children)

Coherent originality does not point to the machine’s understanding; the human is the one capable of finding a result coherent and weighting their program to produce more results in that vein.

Your brain does not function in the same way as an artificial neural network, nor are they even in the same neighborhood of capability. John Carmack estimates the brain to be four orders of magnitude more efficient in its thinking; Andrej Karpathy says six.

And none of these tech companies even pretend that they’ve invented a caring machine that they just haven’t inspired yet. Don’t ascribe further moral and intellectual capabilities to server racks than do the people who advertise them.

[–] CanadaPlus@lemmy.sdf.org 1 points 4 hours ago* (last edited 4 hours ago)

Coherent originality does not point to the machine’s understanding; the human is the one capable of finding a result coherent and weighting their program to produce more results in that vein.

You got the "originality" part there, right? I'm talking about tasks that never came close to being in the training data. Would you like me to link some of the research?

Your brain does not function in the same way as an artificial neural network, nor are they even in the same neighborhood of capability. John Carmack estimates the brain to be four orders of magnitude more efficient in its thinking; Andrej Karpathy says six.

Given that both biological and computer neural nets very by orders of magnitude in size, that means pretty little. It's true that one is based on continuous floats and the other is dynamic peaks, but the end result is often remarkably similar in function and behavior.

[–] captain_aggravated@sh.itjust.works 25 points 1 day ago (2 children)

Well I've got the name for my autobiography now.

[–] runeko@programming.dev 4 points 11 hours ago

"Specifically Annoying" or "Plausible Bullshit"? I'd buy the latter.

[–] Irelephant@lemm.ee 1 points 2 hours ago

This is where I got the term from: https://craphound.com/news/2023/09/17/plausible-sentence-generators/

[–] petey@aussie.zone 1 points 8 minutes ago

It needs good feedback. Agentic systems like Roo Code and Claude Code run compilers and tests until it works (just gotta make sure to tell it to leave the tests alone)