this post was submitted on 30 May 2024
145 points (97.4% liked)

Technology

59627 readers
2911 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

cross-posted from: https://sopuli.xyz/post/13237910

Amazon Cloud Traffic Is Suffocating Fedora's Mirrors

top 8 comments
sorted by: hot top controversial new old
[–] empireOfLove2@lemmy.dbzer0.com 70 points 5 months ago* (last edited 5 months ago) (1 children)

You would think Amazon would do the intelligent thing and host cache mirrors of repos local to their data centers. Not only is it not much data to store relatively speaking, it allows install and deployment at however fast your inner network is (10g+) vastly paying for itself in faster setup saving otherwise wasted time.

Something tells me they do do that and it just broke, and AWS being AWS, nobody noticed.

[–] Max_P@lemmy.max-p.me 23 points 5 months ago

They do at least for Ubuntu. One local to each AWS region even, not just one. Bandwidth is expensive, it's all in their interest to have as much locally as possible than go out for mirrors. That definitely looks like something broke.

Those could very well be a bad batch of AMIs and now that they've all been spun up as instances there's no taking it back short of emailing customers and politely asking them to fix the mirrors.

Or people are just following online guides and adding that particular repo copy pasting the mirror line which goes to the public mirrors.

[–] pHr34kY@lemmy.world 46 points 5 months ago (2 children)

My company has build scripts that practically pull half an OS from an update mirror every time someone commits a code change.

It's maddening how inefficient CI/CD setups are.

[–] Stupidmanager@lemmy.world 4 points 5 months ago

It's maddening how inefficient CI/CD setups are.

It's maddening how inefficient ~~CI/CD setups~~ inexperienced DevOps engineers are. - Fixed that for you.

Proper pipelines are modular and should run longer validation or updates externally, with only necessary stages executing.

  • code validate - will this code compile
  • code secure - are there any known security flaws introduced
  • code plan/compile - if it’s iac, plan, if it’s application code, compile
  • if it’s prod or like, approve required (human delay). Dev, test, uat - proceed with deploy
  • code deploy - push code live

Things like: patching, config management, vulnerability scanning, compliance checks, etc… are done outside the pipeline.

There’s a reason people like me charge a lot! Lazy and/or inexperienced staff will get you in trouble one day.

[–] steal_your_face@lemmy.ml 2 points 5 months ago

Pop the images you use into your local image repository.

[–] just_another_person@lemmy.world 2 points 5 months ago

Probably a number or large installation bases switching.

[–] bamboo@lemm.ee 2 points 5 months ago

Amazon Linux probably includes EPEL by default now

[–] FalseMyrmidon@kbin.run 1 points 5 months ago

AmazonLinux doesn't have epel on by default afaik? Seems unlikely this is Amazon the company and not their customers