this post was submitted on 09 Dec 2025
530 points (99.3% liked)
Linux
10508 readers
1092 users here now
A community for everything relating to the GNU/Linux operating system (except the memes!)
Also, check out:
Original icon base courtesy of lewing@isc.tamu.edu and The GIMP
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
AI agents and web scrapers surely
I would expect AI scrapers to fake a windows user-agent tbh.
Why? Isn't it likely that it'll just report e.g. "python-requests" for the user agent, and it's up to the server side to decide what that means?
Just hard to believe 6%. That's a huge number. Hopefully it's true🤞