this post was submitted on 23 Dec 2025
636 points (97.7% liked)
Technology
77899 readers
2381 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You want to see someone using say, VS Code to write something using say, Claude Code?
There's probably a thousand videos of that.
More interesting: I watched someone who was super cheap trying to use multiple AIs to code a project because he kept running out of free credits. Every now and again he'd switch accounts and use up those free credits.
That was an amazing dance, let me tell ya! Glorious!
I asked him which one he'd pay for if he had unlimited money and he said Claude Code. He has the $20/month plan but only uses it in special situations because he'll run out of credits too fast. $20 really doesn't get you much with Anthropic 🤷
That inspired me to try out all the code assist AIs and their respective plugins/CLI tools. He's right: Claude Code was the best by a HUGE margin.
Gemini 3.0 is supposed to be nearly as good but I haven't tried it yet so I dunno.
Now that I've said all that: I am severely disappointed in this article because it doesn't say which AI models were used. In fact, the study authors don't even know what AI models were used. So it's 430 pull requests of random origin, made at some point in 2025.
For all we know, half of those could've been made with the Copilot gpt5-mini that everyone gets for free when they install the Copilot extension in VS Code.
It's more I want to see the process of experienced coders explaining the coding mistakes that typical AI coding makes. I have very little experience and see it as a good learning experience. You're probably right about there being tons of videos like that.
The mistakes it makes depends on the model and the language. GPT5 models can make horrific mistakes though where it randomly removes huge swaths of code for no reason. Every time it happens I'm like, "what the actual fuck?" Undoing the last change and trying usually fixes it though 🤷
They all make horrific security mistakes quite often. Though, that's probably because they're trained on human code that is *also" chock full of security mistakes (former security consultant, so I'm super biased on that front haha).