this post was submitted on 20 Oct 2025
641 points (98.3% liked)
Technology
76252 readers
3240 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
So Roblox is the only of those companies that can handle proper region failover if us-east-1 shits the bed? You young ops have gotten soft! Learn to live by ChaosMonkey or die by the Gorilla.
Yeah, but proper failover and recovery requires additional infrastructure, and that costs money.
Hopefully a bunch of risk management people are writing I-told-you-so emails to C-suites right now.
Yeah but not to worry, C-suites have pretty good filtering rules in place to never read them. Saves time, really.
And plausible deniability.
Yup, and some things which can be moved cannot be done automatically, quickly or easily....even if you are prepared. AWS is a huge suite of products and services, and there's a lot of old legacy shit running on it. I wouldn't punch down on the ops for this one. Cybersecurity and disaster recovery are not directly profitable, so they are almost always neglected in your average shop.
Yup, AWS is legacy cloud. It was only recently that they set encryption by default on S3 buckets, before that they were just in the clear by default.
It's never important until suddenly it's the most important thing in the world.
Either that, or the reports stopped coming in since it's a school day.
Roblox doesn't really lock down regions unless they are China. The game client can connect to any server they own. It naturally falls back to the server with the least issues without prompts and intervention. If for an even bigger example all US servers were to go offline, the client automatically redirects people to either Europe or Asia based on ping.
I think they're the only ones doing multi-cloud. If us-east-1 shits the bed, it's a bad day for AWS in general.