this post was submitted on 24 Jul 2024
21 points (57.7% liked)
Technology
59605 readers
3345 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Energy usage included?
Well, it says 100k H100s.
Looks like an H100 is 700W.
looks at WP's table of the TOP500 list of supercomputers
https://en.wikipedia.org/wiki/TOP500
The top entry there -- has, as accelerator cards, 36,992 MI250Xs, which are apparently 500W each.
It's the highest compute card count other than one using Intel Max 1550s, which has 63,744 cards, which are 600W each.
I'm not sure that the TOP500 is necessarily the best ranking here, since I don't know if it's the best metric for GPU-style compute, and the CPUs are also a factor. But at least going off what he's saying, it'd probably rank above those for GPU power consumption (and compute capacity).