1133
Codeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.
(i.imgur.com)
cross-posted from: https://programming.dev/post/35852706
Eventually we'll have "defensive" and "offensive" llm's managing all kinds of electronic warfare automatically, effectively nullifying each other.
That's actually a major plot point in Cyberpunk 2077. There's thousands of rogue AI's on the net that are constantly bombarding a giant firewall protecting the main net and everything connected to it from being taken over by the AI.
The game is an excellent documentary.
Not to mention the firewall is itself AI.
Unrelated, but I saw this headline, and could hear both you and squidward swearing from here.
It doesn't bode well. Honestly I fear at some point in the future, if these countermeasures can't keep up, small sites may need to close themselves off with invite-only access. Hopefully that's quite a distant future.
Places like cloudflare and akamai are already using machine learning algorithms to detect bot traffic at a network level. You need to use similar machine learning to evade them. And since most of these scrapers are for AI companies I'd expect a lot of the scrapers to be LLM generated.
Obligatory AI ≠ LLM. How would scrapers benefit from the LLMs they help train? The defense is obvious, LLM-generated slop traps against scrapers already exist.