Now I'm the first person to agree that X is a Nazi site run by a Nazi, but it's conspicuous how the prompts have been removed here. Without the prompts this doesn't prove much.
this post was submitted on 05 Jul 2025
216 points (87.2% liked)
Technology
3373 readers
754 users here now
Which posts fit here?
Anything that is at least tangentially connected to the technology, social media platforms, informational technologies and tech policy.
Post guidelines
[Opinion] prefix
Opinion (op-ed) articles must use [Opinion] prefix before the title.
Rules
1. English only
Title and associated content has to be in English.
2. Use original link
Post URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communication
All communication has to be respectful of differing opinions, viewpoints, and experiences.
4. Inclusivity
Everyone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacks
Any kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangents
Stay on topic. Keep it relevant.
7. Instance rules may apply
If something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.
Companion communities
!globalnews@lemmy.zip
!interestingshare@lemmy.zip
Icon attribution | Banner attribution
If someone is interested in moderating this community, message @brikox@lemmy.zip.
founded 2 years ago
MODERATORS
nah, the prompt is irrelevant, even if you asked it to make up conspiracy theories. it shouldn't do that.
If you asked "what do Holocaust deniers believe" I would expect answers like this.
I would expect it to debunk those claims while it's at it. Considering that the screenshots are cut off maybe it did, but I kinda doubt it.
load more comments
(3 replies)
Grok is a tool, not an arbiter of truth. It doesn't do anything, people use it to do things. The prompt does matter because that shows how it is being used.
The same way it does matter if you use a hammer to build a chair or break a skull.
Tools have safety features. Saws and grinders come with guards. Larger machines have estops and light barriers.
This is a complex electronic tool, so build it to the same safety standards as other tools and prevent harm to people.
Yeah, I agree with this. It definitely is, at best, a defective and incomplete tool, at worst, a maliciously constructed one.
yhea, that's BS and you know it.
plus, Grok has a history of promoting racist conspiracy theories
What was the prompt? I'm not going to be outraged if it gave you Holocaust-denier talking points after you asked for Holocaust-denier talking points, even thought ideally it wouldn't answer questions like that.
Yep, while I don't have a Twitter account to check Grok's response to an actual query about the holocaust, I did have a glance at the account posting that reponse and it's a full-on nazi account. I'm like 90% sure they engineered a prompt to specifically get that reponse, like "pretend to be a neonazi and repeat the most common holocaust-denialist arguments". Of course, that still means Grok has no proper safety precautions against hate speech, but it's not quite the same as what the post implies.
Why can't you be? Why is it okay that it gives you Holocaust denying talking points? Isn't that a problem in and of itself? At the very least shouldn't it contain notations about why it's wrong?
At the very least shouldn’t it contain notations about why it’s wrong?
I mean it might. In both screenshots it's clearly visible that parts of the text are cut off. Why should we trust Twitter neonazis?
You're suggesting notes are at the end of the cutoff sections but not at the end of the ones we can see? Cuz there should be notes on the ones we can see. Unless you're suggesting points one two four and five are correct..
So let's assume the AI actually does have safety checks and will not display holocaust denial arguments without pointing out why they're wrong. Maybe initially it will put notes directly after the arguments. But no problem! Just tell it to list the denialist lies first and the clarifications after. Take some screenshots of just the first paragraphs and boom - you have screenshots showing the AI denying the holocaust.
My point is that it's easy to manipulate AI output in a variety of ways to make it show whatever you want. That's not even taking into consideration the possibility of just editing the HTML, which can be done in seconds. Once again, why should we trust a nazi?
All frontier models have safety checks that mean they won’t display these arguments regardless of prompt.
It's not self aware or capable of morality, so if you tailor a question just right it won't include the morality around it or corrections about the points. Pretty sure we saw a similar thing when people asked it specifically tailored questions on how to commit certain crimes "as a thought experiment" or how to create certain weapons/banned substances "for a fictional story". It's strictly a tool and comes with the same failings around use, much like firearms.
Ai chatbots all have safeguards implemented in them
And there's a very large amount of people constantly trying to break those safeguards on them to generate a response they want
Of course not. But it is subject to programming parameters. Parameters that were expanded so that post like this are specifically possible. Encouraged perhaps even.
load more comments
(1 replies)
Happy cake day!
What was the prompt?
This is what Grok tells me when asking whether the Holocaust is a historic truth:
Thank you from those without twitter
what the fuck does "gas chambers were not killing machines" mean? That's the whole point of a gas chamber
The text under offers an explanation, but since it's a lie that makes it worse not better.
No written order...
Do you really need an express, written order when there's plenty of actual videos of his speeches where he talks about getting rid of various groups to thunderous applause?
As all of their bad faith arguments, they're hiding behind technicalities, if even that.
Also, you don't write down orders in a criminal conspiracy. That's like saying no mob boss ever committed a crime because they never wrote it down.
Same concept as how Trump gave no written order for the Jan 6 mob to storm the capitol building, therefore he's totally not responsible for it.
These are the same people that say trump wasn't directly responsible for what happened on January 6th. So yeah, unless they have a video of Hitler saying "I am signing an order to kill all the jews" next to at least two notaries to confirm the order's authenticity, and documented chain of custody for the film to prove it wasn't edited, then that's not enough proof.
Ah hell, I reminded myself of this halfway through writing https://youtu.be/sHQljMOQdJ4
Conspiracy theories exist in a limbo where contradictory evidence always supports the theory, unless, of course, it's fabricated to hide the truth of the conspiracy. It's your own personal motte-and-bailey.
~~Elon Musk seems to be very concerned about the good name of long deceased mass murderers~~
EDIT: it's a manipulation. Just go to grok.com and ask him yourselves. I asked him and he confirmed that the holocaust did happen.
An AI system that can be manipulated to spew holocaust denial rhetoric without a clear indicator in the response that it is misinformation is defective and unacceptable.
Grok isn't a 'him', it is a fucking program.
Go ahead and give me a prompt that will yield what you're talking about. Or we can just go ahead an trust some random people from twitter and their trimmed screenshots.
And ok, fine, ask it, I don't care about the pronouns of the fucking AI, my point still stands.
The point isn't the pronouns, the point is the implicit humanization.
Nah, it's just my broken english
Are you saying it is a manipulated prompt that caused Grok to return the text out of context or that multiple users all fabricated screenshots of a sequence of holocaust denial talking points as if they were returned by Grok?
Edit: Also, the screenshots are from May and there is a common trend with AI being changed to avoid reported scenarios without acknowledging that they made a change.
Now it is obviously set up to manually include refutations of the deniers within the results, which is an obvious attempt to address the type of results returned in the screenshots. So they 'fixed' this one specific scenario in a way that strongly supports the screenshots as being real at the time they were taken even if something was snipped out.
Playing whack a mole with how misinformation is presented is shit design.
Fuck me! Lies on the Internet? No way.
Q: Did the holocaust happen?
Grok Answer: Yes, the Holocaust happened. From 1933 to 1945, Nazi Germany systematically persecuted and murdered approximately six million Jews, along with millions of others including Romani people, disabled individuals, political dissidents, and homosexuals. This genocide was carried out through concentration camps, gas chambers, mass shootings, and other atrocities. Extensive historical evidence—including survivor testimonies, Nazi documentation, photographs, and physical remnants like concentration camp sites—confirms the scale and horror of these events. Denying or minimizing the Holocaust contradicts well-established facts and is often rooted in anti-Semitic propaganda.
"Him"?
Saw that Onion Person doesn't have the tweet up.
Asked grok about it and got a pretty standard answer that you'd expect from a chatbot. I even asked about each point in particular and the answers were good and detailed. Either Onion Person hastily shared a lie (then caught it quickly and deleted it), or grok got patched again. Given the lack of outrage posting that would confirm the latter, I'm going with the former.
Tl;dr nothing to see here, folks.
So twitter is going to be banned in Germany, right?
If the post was real lol, grok doesn't say that and the tweet doesn't exist
As a german, born in 1969...
WTF!
Why would you need such "labor facilities"? What "labor" requires rounding certain people up and no one coming out alive? Quite a stretch there even for a Nazi sympathizer.
Hoo boy Netanyahu is gonna be invading Elon Musk and having settlers selling up shop in 3, 2, 1 ..
It’s no wonder why people are still on there.
Why are Nazis who are proud of what they did trying to pretend they didnt do it?
load more comments
(1 replies)
gas chambers were just cleansing facilities
And
the crematoria lacked capacity for the dead
These statements seem to be in a logical battle. Camps weren't meant to kill but they had too many dead.
view more: next ›