this post was submitted on 27 May 2024
1355 points (99.5% liked)
Technology
59589 readers
3300 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Not surprising. They archive information that powerful people would rather we forget.
I doubt this has to do with "powerful people". A DDOS attack does not remove anything from the net, but only makes it temporarily hard to reach.
There are firms that specialize in suppressing information on the net. They use SEO tricks to get sites down-ranked, as well as (potentially fraudulent) copyright and GDPR request.
There must be any number of "little guys" who hate the Internet Archive. They scrape copyrighted stuff and personal data "without consent" and even disregard robots.txt. Lemmy is full of people who think that people should go to jail for that sort of thing.
Can you elaborate on the last part?
TBH I can understand that it's a problem for people who aren't expecting it. If they disregard instructions not to index things then that's also a problem. The only real way to prevent scrapers from replicating content is to place it behind a registration wall.
https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/
Does this answer the question?