Oh my god… This is one of the best blogs I have EVER seen. I added it to my RSS feed right after reading that post.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
If you're into podcasts, he has one too - its called Better Offline.
Thanks!
Really? I thought it had a lot of problems. Weird editor's notes in a bunch of places that add nothing. An intro that is too long.
Some of the arguments were just plain wrong. For example, the argument that it's obvious that the internet is good for ordering books is an argument from incredulity. And on top of that, people did argue exactly what he's saying they wouldn't argue. I remember. I was there.
Most of the general advice is good, and I agree with the premise of the article, but it didn't strike me as one of the best blogs ever.
There's also the fact that what we are currently calling AI isn't, that there are better options that aren't environmental catastrophes (I'm hopeful about small language models), and that no one seems to want all the "AI" being jammed into every goddamn thing.
No, I don't want Gemini in my email or messaging, I want to read messages from people myself. No, I don't want Copilot summaries of my meetings in Teams, half the folks I work with have accents it can't parse. Get the hell out of my way when I'm trying to interact with actual human beings.
And I say that as someone whose job literally involves working with LLMs every day. Ugh.
I think the main thing that's happening is analogous to what's happened with a lot of electronics over the past couple of decades. It seems like every electronic device runs off of a way more powerful computer than is necessary because it's easier/cheaper to buy a million little computers and do a little programming than it is to have someone design a bespoke circuit, even if the bespoke circuits would be more resource efficient, robust, and repairable. Our dishwashers don't need wifi, but if you are running them off a single board computer with wifi built in, why wouldn't you figure out a way to advertise it?
Similarly, you have all sorts of tasks that can be done with way more computational efficiency (and trust and tweakability) if you have the know-how to set something bespoke up, but it's easier to throw everything at an overpowered black box and call it a day.
The difference is that manufacturing costs for tiny computers can come down to be cheaper in price relative to a bespoke circuit, but anything that decreases the cost of computing will apply equally to an LLM and a less complex model. I just hope industry/government pushing isn't enough to overcome what the "free market" should do. After all, car centric design (suburbia, etc) is way less efficient than train centric, but we still went there.
My work would be improved by the dumbest of dumb retrieval augmented models: a monkey with a thesaurus, ctrl+f, and a pile of my documents. Unfortunately, the best they can offer is a service where I send my personal documents into the ether and a new wetland is dried in my honor (or insert your ecological disaster metaphor of choice).
With dishwashers at least it would be cheaper to manufacture them with a different board without wifi.
Cheaper to manufacture, yes, but then they'd lose all the sweet residuals from selling consumer data.
No one checks the privacy policy for a dishwasher. If a washing machine can send over 3gb of data in a day, I'd bet every other "smart" appliance is doing something similar.
Also worth checking out is his Hater's Guide to the AI Bubble. I listened to the three part podcast. He's the only person I have to listen to at less than 1x, but it's really good stuff.
Personally I get a lot of value out of LLMs. I’ve used them almost everyday for the last three years in various projects and general chat bots, but I wouldn’t call myself an AI Booster. I’ve heard the criticisms about Gen AI the author addresses and I believe this is another case of blaming technology instead of the capitalists behind it. Do you hate the fact that a computer can generate text or images or do you really just hate the assholes that unethically scraped all of our human achievements for their benefit and are willing to destroy everything to enrich themselves on our labor? I bet it’s the latter.
It's the latter, counter point; the tool never would have existed without the unethical scraping.
He's pretty explicit in that regard. He even added an interesting point at the start of the article : most people he knows who actually work with AI and know shit about it are not boosters. It's an important distinction that Ed doesn't ignore.
He is against the over hype of "AGI" and skeptical of the hundreds of billions that have been poured into it for sinister reasons. He's not denying that the tech has uses, but rather confronting the value of those uses with their actual, non subsidized cost.
(The paste above stops just before the table of contents)
https://www.wheresyoured.at/how-to-argue-with-an-ai-booster/#table-of-contents