this post was submitted on 21 May 2025
545 points (98.7% liked)

Technology

70259 readers
3659 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Researchers published a massive database of more than 2 billion Discord messages that they say they scraped using Discord’s public API. The data was pulled from 3,167 servers and covers posts made between 2015 and 2024, the entire time Discord has been active.

Though the researchers claim they’ve anonymized the data, it’s hard to imagine anyone is comfortable with almost a decade of their Discord messages sitting in a public JSON file online. Separately, a different programmer released a Discord tool called "Searchcord" based on a different data set that shows non-anonymized chat histories.

top 50 comments
sorted by: hot top controversial new old
[–] asbestos@lemmy.world 244 points 2 days ago (3 children)

Probably our only chance to find solutions to problems with open source software that uses Discord as their forum

[–] boatswain@infosec.pub 134 points 2 days ago (3 children)

Seriously. It's beyond painful when some open source project only uses Discord for communication. You have to hope that you post your question at a time when the right people are online, and that there's not a more interesting conversation going on, otherwise it just gets lost. Index that whole dataset.

[–] ALostInquirer@lemm.ee 17 points 2 days ago (4 children)

Given some similar issues, why is it some projects still use IRC then?

[–] Quill7513@slrpnk.net 53 points 2 days ago

there's a difference between using irc for livetime troubleshooting and not having a forum at all and directing everyone to your livechat discord. i'm sure some sicko out there has run an OSS project on only IRC, but their project likely got no traction because a history of problemsolving posts is important in open source. generally speaking, you need:

  • a wiki
  • a static indexable searchable forum
  • a live chat place for real time communication for novel problems

too many projects these days only have that last one in the form of discord

[–] phoenixz@lemmy.ca 13 points 2 days ago

Because IRC is awesome, always has been

[–] boatswain@infosec.pub 12 points 2 days ago

That would be equally annoying. Probably a better signal to noise ratio on IRC though; Discord descends into memes almost instantly.

[–] AugustWest@lemm.ee 9 points 1 day ago

For projects I am involved with all irc chats are archived and searchable. There is nothing private, no registration needed and searchable.

Quite a bit different.

[–] Peffse@lemmy.world 6 points 1 day ago

I've always wanted to contribute to The Cutting Room Floor wiki but they hide registration behind a Discord server bot that will give the registration code.

load more comments (1 replies)
[–] Dojan@pawb.social 16 points 2 days ago (4 children)

I spent nearly three hours today between discord and matrix trying to figure out how to get these two pieces of software to talk using a certain protocol.

Imagine if there were online indexable platforms where people could publish this information so it’s easily accessible rather than having to scour through message logs hoping to find the right keywords. Such a technology surely doesn’t exist already, right?

I hate discord.

[–] dual_sport_dork@lemmy.world 36 points 2 days ago (1 children)

I don't hate Discord, I simply hate that so many projects and companies have unanimously decided to use it as the wrong tool for the wrong job.

It's fine for its intended use case, which is bickering with my friends about video games and fiction, and spamming each other with .gifs and meme images.

[–] MBech@feddit.dk 17 points 2 days ago (4 children)

Discord is genuinely a great tool for what I used to use Skype for. Talking to my friends, and sharing dumb memes with them in a groupchat format. Companies need to learn that using it as a forum, a Q&A service, a wiki or any other information sharing purpose, is simply fucking retarded.

load more comments (4 replies)
[–] MDCCCLV@lemmy.ca 3 points 1 day ago

Yeah, but then you have something like when people protest deleted their history on reddit which is fine as a protest tactic but leaves a hole where your specific question came up but now there's nothing there.

load more comments (2 replies)
[–] nawa@lemmy.world 13 points 2 days ago

Lol, I've read this headline and thought "thank fuck, probably the only option to have Discord's content readable", I like how universal this opinion is

[–] Metz@lemmy.world 118 points 1 day ago

So basically discord finally got a usable search. I count that as a win.

[–] donuts@lemmy.world 87 points 2 days ago (3 children)

Well yeah, it's not encrypted. It would be the same as 10 years of Reddit posts or Lemmy posts scraped

[–] simple@lemm.ee 81 points 2 days ago (7 children)

This isn't even them scraping private chats and small servers, they just scraped public servers in the discovery tab. None of that information was ever private, and every user can browse the chat history there.

[–] donuts@lemmy.world 35 points 2 days ago

Yeah, exactly. It may sound scary or like a violation of privacy, but there is no privacy when posting to public online areas.

[–] micka190@lemmy.world 25 points 2 days ago

"Researchers scrape thousands of hours of news footage from their TVs!" is about as big a deal, honestly.

[–] taiyang@lemmy.world 8 points 2 days ago

In other words-- your sexting is safe, friends.

load more comments (4 replies)
[–] Quibblekrust@thelemmy.club 5 points 1 day ago

There's literally no difference. Each Discord server is like a tiny chunk of Reddit. If anyone expected any privacy on these servers, they're nuts.

[–] melroy@kbin.melroy.org 3 points 2 days ago

It's indeed not a miracle.

[–] Tattorack@lemmy.world 65 points 1 day ago (4 children)

I see a lot of drama here in the thread, people decrying data leaks, how Discord is very very bad, and a number of people wanting the "good old days" of forums.

Yes. I like forums too, but, uh...

These researchers scraped publicly posted messages. Keyword here being "public". How would anything similarly public, like a forum, be better?

I actually remember the times when forums were at their peak. I hung out on BZPower for Bionicle things, and the Relic News Forum for Homeworld modding. You know what they had? Google bots that scraped messages, looked for certain words, and populated websites with advertisements based on what it could scrape from forums.

Pretty sure Lemmy doesn't do encryption either, unless there's some very special, private Lemmy server that nobody has access to. So the researchers could've just as well scraped the fediverse.

[–] Gibibit@lemmy.world 18 points 1 day ago (1 children)

Yeah this being just as easy on bb forums or literally any webpage with a public comment section was my first thought as well..

Isn't most of the internet scraped anyways, by the internet archive? The concerning part is that this is 100% going to be used to train some coomer brained AI. Scraping, botting, scamming: all those things are going to happen on large public communities.

[–] Melvin_Ferd@lemmy.world 5 points 1 day ago* (last edited 1 day ago)

Yeah, a lot of this push is about ushering in new laws to prevent data scraping.

Propaganda spreads easily through fake accounts—but how do we detect large-scale operations if they’re constantly creating and deleting accounts or trying to blend in with the rest of us? We’d need access to massive data sets to mine for patterns and expose coordinated behavior.

But the powers that benefit from shaping the narrative are the same ones pushing the idea that all scraping is bad. They want people to hate it, so they can justify laws that lock down access. That’s the end game.

[–] FauxLiving@lemmy.world 7 points 1 day ago

How would anything similarly public, like a forum, be better?

Forums were the primary way that groups would talk with one another pre-global scale social media.

They could contain public subforums, but the majority of all of the forums that I've been a part of were not viewable without an account, which was manually approved or required a small payment (to make bans have a chance to actually stick).

[–] hansolo@lemm.ee 4 points 1 day ago* (last edited 22 hours ago)

People in general have no idea and just want to get spun up on drama and manufactured outrage.

Same thing happened when people started scrapping Twitter 10-15 years ago.

load more comments (1 replies)
[–] CosmoNova@lemmy.world 42 points 1 day ago (1 children)

That’s good news. Internet archiving is an important endeavor because you never know when they‘ll pull the plug. Now it‘s a little more secured and probably far more useful than in Discord‘s hands alone.

[–] Mustakrakish@lemmy.world 4 points 1 day ago (3 children)

Not for messages that are supposed to be private lol. Let me just make a copy of all texts you've sent over the last decade, for "archiving".

This says it was done via the API so they wouldn't be private messages.

[–] nomy@lemmy.zip 3 points 21 hours ago

Texts are sent in plain-text and I wouldn't recommend discussing anything you'd like to keep private via text.

load more comments (1 replies)
[–] sp3ctr4l@lemmy.dbzer0.com 17 points 1 day ago (1 children)

So this is:

'Uh guys, Discord chats leaked..."

For... what, just literally everyone who used Discord between 2015 and 2017, everyone who was an early adopter?

Dear fucking god.

I used to say 'someday, people will learn', but fucking no obviously not, no they won't, almost everyone is an idiot and/or truly doesn't care.

... I guess this'll be fodder for a whole bunch of dramatubers / pedohunters for the next year or so...

load more comments (1 replies)
[–] lefixxx@lemmy.world 16 points 1 day ago

"scraped" via API? I don't think It means what you think it means.

[–] snowsuit2654@lemmy.blahaj.zone 15 points 21 hours ago* (last edited 21 hours ago)

"anonymized" sure. I highly doubt they read every message. I'm sure there is lots of de-anonymizing information in the messages themselves

For example--

Anon1: "hey jeff, wanna play Minecraft?"

Anon2: "sure"

Thus we know Anon2's name is Jeff. I imagine there's a lot of this.

[–] fullsquare@awful.systems 13 points 2 days ago

🚩

marked safe

from Brazilian mass discord message leak

(never used discord)

[–] thesohoriots@lemmy.world 10 points 2 days ago

They just wanted to find new slurs.

[–] ABetterTomorrow@lemm.ee 10 points 1 day ago (3 children)

wtf…… going to get worse after IPO!

load more comments (3 replies)
[–] joyjoy@lemm.ee 10 points 2 days ago

Public data should be accessible anonymously. You can't change my mind.

[–] Reygle@lemmy.world 9 points 1 day ago

Ooh! Do Teams next

[–] toastmeister@lemmy.ca 7 points 1 day ago

Great news for open source AI.

[–] obbeel@lemmy.eco.br 5 points 2 days ago

This is just trolling, at this point.

[–] pelespirit@sh.itjust.works 4 points 2 days ago (1 children)

Every time you post, you're posting so that Meta, Google, Reddit and every known retail store like Walmart, Target, Kroger, etc. can see it because they bought that info or harvested it themselves. I think these are great announcements so people can see who sees and manipulates you with your own contributions of data.

[–] dubyakay@lemmy.ca 4 points 1 day ago

The feedback loop is everywhere in tech.

[–] arararagi@ani.social 3 points 15 hours ago

If they were on OPEN servers, I doubt they cared that much.

[–] MrSoup@lemmy.zip 3 points 2 days ago (1 children)

I can't find this "public" json

load more comments
view more: next ›