this post was submitted on 21 Aug 2025
283 points (97.3% liked)

Technology

74324 readers
3899 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Armok_the_bunny@lemmy.world 142 points 1 day ago (17 children)

Cool, now how much power was consumed before even a single prompt was ran in training that model, and how much power is consumed on an ongoing basis adding new data to those AI models even without user prompts. Also how much power was consumed with each query before AI was shoved down our throats, and how many prompts does an average user make per day?

[–] Grimy@lemmy.world 31 points 1 day ago* (last edited 1 day ago) (16 children)

I did some quick math with metas llama model and the training cost was about a flight to Europe worth of energy, not a lot when you take in the amount of people that use it compared to the flight.

Whatever you're imagining as the impact, it's probably a lot less. AI is much closer to video games then things that are actually a problem for the environment like cars, planes, deep sea fishing, mining, etc. The impact is virtually zero if we had a proper grid based on renewable.

[–] Damage@feddit.it 60 points 1 day ago (11 children)

If their energy consumption actually was so small, why are they seeking to use nuclear reactors to power data centres now?

[–] finitebanjo@piefed.world 7 points 1 day ago* (last edited 1 day ago)

Because the training has diminishing returns, meaning the small improvements between (for example purposes) GPT 3 and 4 will need exponentially more power to have the same effect on GPT 5. In 2022 and 2023 OpenAI and DeepMind both predicted that reaching human accuracy could never be done, the latter concluding even with infinite power.

So in order to get as close as possible then in the future they will need to get as much power as possible. Academic papers outline it as the one true bottleneck.

load more comments (10 replies)
load more comments (14 replies)
load more comments (14 replies)