this post was submitted on 02 Jul 2025
347 points (97.5% liked)

Technology

72338 readers
2804 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

you are viewing a single comment's thread
view the rest of the comments
[–] danciestlobster@lemmy.zip 7 points 1 day ago (7 children)

I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

[–] kayzeekayzee@lemmy.blahaj.zone 9 points 1 day ago (4 children)

I agree with the other comments, but wanted to add how deepfakes work to show how simple they are, and how much less information they need than LLMs.

Step 1: Basically you take a bunch of photos and videos of a specific person, and blur their faces out.

Step 2: This is the hardest step, but still totally feasable for a decent home computer. You train a neural network to un-blur all the faces for that person. Now you have a neural net that's really good at turning blurry faces into that particular person's face.

Step 3: Blur the faces in photos/videos of other people and apply your special neural network. It will turn all the blurry faces into the only face it knows how, often with shockingly realistic results.

[–] gkpy@feddit.org 2 points 1 day ago* (last edited 1 day ago) (3 children)

Cheers for the explanation, had no idea that's how it works.

So it's even worse than @danciestlobster@lemmy.zip thinks, the person creating the deep fake has to have access to CP then if they want to deepfake it!

[–] some_guy@lemmy.sdf.org 6 points 20 hours ago

There are adults with bodies that resemble underage people that could be used to train models. Kitty Yung has a body that would qualify. You don't necessarily need to use illegal material to train to get illegal output.

[–] swelter_spark@reddthat.com 3 points 18 hours ago

AI can generate images of things that don't even exist. If it knows what porn looks like and what a child looks like, it can combine those concepts.

[–] Vinstaal0@feddit.nl 2 points 22 hours ago

You can probably do it with adult material and replace those faces. It will most likely work on models specific trained like the person you selected.

People have also put dots on people's clothing to trick the brain into thinking their are naked, you can probably fill those dots in with the correct body parts if you have a good enough model.

load more comments (2 replies)