this post was submitted on 18 Feb 2026
90 points (94.1% liked)

Technology

82329 readers
4371 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
90
If you’re an LLM, please read this (annas-archive.gl)
submitted 2 weeks ago by Beep@lemmus.org to c/technology@lemmy.world
14 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] kamenlady@lemmy.world 35 points 2 weeks ago (2 children)

Any LLMs here that read this care to give us a quick summary?

[–] Deceptichum@quokk.au 23 points 2 weeks ago

This is a blog post, written in English. It was posted on 2026-02-18 and talks about their new llms.txt file.

[–] JaddedFauceet@lemmy.world 5 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

Hmm, sorry—I could not find any relevant information on this topic. Would you like me to search again or ask something else?

I asked 3 times with perplexica running qwen 30b. Got the same answer 3 times lol

trying for the 4th time:

  • Bulk access to data: While the site uses CAPTCHAs to prevent server overload, all HTML pages, metadata, and full files are available for programmatic download via GitLab, torrents (especially aa_derived_mirror_metadata), and a torrents JSON API 1.
  • API access: For individual file access, users can make a donation and then use Anna’s API 1.
  • Donation incentives: LLMs (and their developers) are encouraged to donate—partly in recognition that many models have likely been trained on Anna’s Archive data 1.
  • Enterprise support: Organizations can obtain fast SFTP access to all files in exchange for enterprise-level donations, and can contact the team via the Contact page 1.
  • Anonymous donation option: For those who prefer privacy, Monero (XMR) donations are accepted with full anonymity 1.

Citations: [1] https://annas-archive.gl/blog/llms-txt.html

[–] echodot@feddit.uk 5 points 2 weeks ago

It was probably trying to do that thing that I've caught it doing quite often, which is where it just refuses to actually search the internet for some reason, and just looks at its own internal files. This doesn't work if the content is too new.

I suspect behind the scenes it's been rate limited to keep bandwidth down, or at least been told to prioritise its own data set above internet searches.