382
Based on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlers
(jlai.lu)
I really hope they die soon, this is unbearable…
this post was submitted on 13 Feb 2026
382 points (98.7% liked)
Selfhosted
56379 readers
1123 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
-
No low-effort posts. This is subjective and will largely be determined by the community member reports.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It's already hard enough for self-hosters and small online communities to deal with spam from fleshbags, now we're being swarmed by clankers. I have a little Mediawiki to document my ~~deranged maladaptive daydreams~~ worldbuilding and conlanging projects, and the only traffic besides me is likely AI crawlers.
I hate this so much. It's not enough that huge centralized platforms have the network effect on their side, they have to drown our quiet little corners of the web under a whelming flood of soulless automata.
I was up 10 to 20 percent month over month, and suddenly up 1000% it has spiked hard and they all are data harvesters.
I know I am going to start blocking them, which is too bad, I put valuable technical information up, with no advertising, because I want to share it. And I don't even really mind indexers or even AI learning about it. But I cannot sustain this kind of bullshit traffic, so I will end up taking a heavy hand and blocking everything, and then no one will find it.
Anubis is supposed to filter out and block all those bots from accessing your webpage.
Iocaine, nepenthes, and/or madore's book of infinity are intended to redirect them into a maze of randomly generated bullshit, which still consumes resources but is intended to poison the bots' training data.
So pick your poison
We've officially reached a place where cyberspace is beginning to look like communing with the arcane. Lol