this post was submitted on 13 Aug 2024
701 points (98.1% liked)
Fediverse
28465 readers
455 users here now
A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).
If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!
Rules
- Posts must be on topic.
- Be respectful of others.
- Cite the sources used for graphs and other statistics.
- Follow the general Lemmy.world rules.
Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Everyone goes to Lemmy.world because unlike most instances it has (effectively) open registration and some popular Lemmy apps use it in their signup flow so new users don't have to understand the intricacies of the fediverse they can just hop straight in.
And this is making a lemmy.world monopoly, which is bad for the fediverse (still better, than reddit).
I think it would definitely be nice to spread users (and communities) across more instances. Doubly so since I'm on an instance that is struggling with the volume of content from Lemmy.world because of what is effectively a limit of how much you can get from one instance at a time.
But if we want people on Lemmy who don't know what Linux is, then we need to avoid that massive barrier of asking users to pick an instance. And the second massive barrier of registration applications.
A good compromise I think would be to have multiple trusted servers with open registrations that the app randomly defaults them to when they go to sign up for an account.
Are you okay lately? I had a look the other day, seems almost fixed:
https://grafana.lem.rocks/d/bdid38k9p0t1cf/federation-health-single-instance-overview?orgId=1&var-instance=lemmy.world&var-remote_instance=lemmy.nz
Aussie.zone on the other is almost a week behind: https://grafana.lem.rocks/d/bdid38k9p0t1cf/federation-health-single-instance-overview?orgId=1&var-instance=lemmy.world&var-remote_instance=aussie.zone
We are fine, but it's not fixed. I have a second VPS running in Finland, using this queue batcher. The Lemmy.world team kindly set up their server to point to this VPS instead of the actual Lemmy.nz server, then the VPS collects all the events and sends them to the Lemmy.nz server in batches of 100.
It keeps us up to date, but it's cheating 😆
Last I heard Aussie.zone doesn't have this setup, but they do have a prefetcher (or rather, Nothing4You, who made the queue batcher, is running a prefetcher for them). This basically takes the new comments and posts from Lemmy.world, and sends a request to Aussie.zone to fetch that post. Because this happens outside the normal federation queue it can be done in parallel. It means when Aussie.zone receives the federated activity from Lemmy.world, it already has it, so it can reply quicker and process more events per second. Lemmy clears out activities older than a week in a weekly scheduled job, which is why you will see Aussie.zone's backlog drop a bit once a week. They won't get that content from Lemmy.world, it's just lost. Because of the prefetcher, it's likely just up/down votes (which can't be prefetched).
Very interesting, thanks!