That's like a gun company claiming using their weapons for robbery is a violation of terms of service.
this post was submitted on 27 Nov 2025
284 points (98.6% liked)
Technology
77090 readers
2459 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
284
OpenAI says dead teen violated TOS when he used ChatGPT to plan suicide - Ars Technica
(arstechnica.com)
I'd say it's more akin to a bread company saying that it is a violation of the terms and services to get sick from food poisoning after eating their bread.
Yes you are right, it's hard to find an analogy that is both as stupid and also sounds somewhat plausible.
Because of course a bread company cannot reasonably claim that eating their bread is against terms of service. But that's exactly the problem, because it's the exact same for OpenAI, they cannot reasonably claim what they are claiming.
That would imply that he wasn't suicidal before. If chatgpt didn't exist he would just use Google.
Look up the phenomenon called "Chatbot Psychosis". In its current form, especially with GPT4 that was specifically designed to be a manipulative yes-man, chatbots can absolutely insidiously mess up someone's head enough to push them to the act far beyond just answering the question of how to do it like a simple web search would.
If the gun also talked to you
Talked you into it*
Yeah this metaphor isn't even almost there
They used a tool against the manufacturers intended use of said tool?
I can't wrap my head around what I'm you're saying, and that could be due to drinking. Op later also talked about not being the best metaphor
Metaphor isn't perfect but it's ok.
The gun is a tool as is an LLM. The companies that make these tools have intended use cases for the tools.
I would say that it is more like a software company putting in their TOS that you cannot use their software to do a specific thing(s).
Would be correct to sue the software company because a user violated the TOS ?
I agree that what happened is tragic and that the answer by OpenAI is beyond stupid but in the end they are suing the owner of a technology for a uses misuse of said technology. Or should we sue also Wikipedia because someone looked up how to hang himself ?
That’s like a gun company claiming using their weapons for robbery is a violation of terms of service.
The gun company can rightfully say that what you do with your property is not their problem.
But let's make a less controversial example: do you think you can sue a fishing rods company because I use one of their rods to whip you ?
“Our deepest sympathies are with the Raine family for their unimaginable loss,” OpenAI said in its blog, while its filing acknowledged, “Adam Raine’s death is a tragedy.” But “at the same time,” it’s essential to consider all the available context, OpenAI’s filing said, including that OpenAI has a mission to build AI that “benefits all of humanity” and is supposedly a pioneer in chatbot safety.
How the fuck is OpenAI's mission relevant to the case? Are suggesting that their mission is worth a few deaths?
Sure looks like it.
Get fucked, assholes.
"All of humanity" doesn't include suicidal people, apparently.
I think they are saying that her suicide was for the benefit of all humanity.
Getting some Michelle Carter vibes...
Tech Bros all think they are the saviors of humanity and they are owed every dollar they collect.
"Some of you may die, but that is a chance I am willing to take."
So why can't this awesome AI be stopped from being used in ways that violate the TOS?
Fucking.WOW.
Sam Altman just LOVES answering stupid questions. People should be asking him about this in those PR sprints.
The police also violated my Terms of Service when they arrested me for that armed bank robbery I was allegedly committing. This is a serious problem in our society people; something must be done!
The situation is tragic... their attempt to hide behind their ToS on that is fucking hilarious.
And open AI violates human culture and creativity. It’s a fucking shame that there are laws against this because that fucker should be up against the wall.
TOS > Everything.
Well there you have it. It’s not the dev’s fault, it’s the AI’s fault. Just like they’d throw any other employee under the bus, even if it’s one they created.
Just going through this thread and blocking anyone defending OpenAI or AI in general, your opinions are trash and your breath smells like boot leather
Does the synthesis of D-Lysergic Acid work against the terms of service if you ask for a mind-bending experience?
Well, did anyone expect them to admit guilt?
Modern version of "suicide is a sin and we don't condone it, but if you have problems you're devil-possessed and need to repent and have only yourself to blame".
Also probably could be countered by their advertising contradicting their ToS. Not a lawyer.