this post was submitted on 07 Dec 2025
785 points (97.8% liked)

Technology

77090 readers
3049 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Just want to clarify, this is not my Substack, I'm just sharing this because I found it insightful.

The author describes himself as a "fractional CTO"(no clue what that means, don't ask me) and advisor. His clients asked him how they could leverage AI. He decided to experience it for himself. From the author(emphasis mine):

I forced myself to use Claude Code exclusively to build a product. Three months. Not a single line of code written by me. I wanted to experience what my clients were considering—100% AI adoption. I needed to know firsthand why that 95% failure rate exists.

I got the product launched. It worked. I was proud of what I’d created. Then came the moment that validated every concern in that MIT study: I needed to make a small change and realized I wasn’t confident I could do it. My own product, built under my direction, and I’d lost confidence in my ability to modify it.

Now when clients ask me about AI adoption, I can tell them exactly what 100% looks like: it looks like failure. Not immediate failure—that’s the trap. Initial metrics look great. You ship faster. You feel productive. Then three months later, you realize nobody actually understands what you’ve built.

you are viewing a single comment's thread
view the rest of the comments
[–] felbane@lemmy.world 20 points 22 hours ago (1 children)

As someone who has been shoved in the direction of using AI for coding by my superiors, that's been my experience as well. It's fine at cranking out stackoverflow-level code regurgitation and mostly connecting things in a sane way if the concept is simple enough. The real breakthrough would be if the corrections you make would persist longer than a turn or two. As soon as your "fix-it prompt" is out of the context window, you're effectively back to square one. If you're expecting it to "learn" you're gonna have a bad time. If you're not constantly double checking its output, you're gonna have a bad time.

[–] oscarjiminy@aus.social 2 points 15 hours ago (1 children)

@felbane @AutistoMephisto i don't have a cs degree (and am more than willing to accept the conclusions of this piece) but how is it not viable to audit code as it's produced so as it's both vetted and understood in sequence?

[–] felbane@lemmy.world 9 points 15 hours ago (1 children)

Auditing the code it produces is basically the only effective way to use coding LLMs at this point.

You're basically playing the role of senior dev code reviewing and editing a junior dev's code, except in this case the junior dev randomly writes an amalgamation of mostly valid, extremely wonky, and/or complete bullshit code. It has no concept of best practices, or fitness for purpose, or anything you'd expect a junior dev to learn as they gain experience.

Now given the above, you might ask yourself: "Self, what if I myself don't have the skills or experience of a senior dev?" This is where vibe coding gets sketchy or downright dangerous: if you don't notice the problems in generated code, you're doomed to fail sooner or later. If you're lucky, you end up having to do a big refactoring when you realize the code is brittle. If you're unlucky, your backend is compromised and your CTO is having to decide whether to pay off the ransomware demands or just take a chance on restoring the latest backup.

If you're just trying to slap together a quick and dirty proof of concept or bang out a one-shot script to accomplish a task, it's fairly useful. If you're trying to implement anything moderately complex or that you intend to support for months/years, you're better off just writing it yourself as you'll end up with something stylistically cohesive and more easily maintainable.

[–] oscarjiminy@aus.social 3 points 15 hours ago

@felbane thanks, such a thorough response really appreciate your time.