this post was submitted on 17 Feb 2024
346 points (98.9% liked)

Technology

59605 readers
3302 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Intel accused of inflating CPU benchmark results::SPEC says Intel's Xeon processors were using a compiler that artificially inflated the results of its industrial benchmark by as much as 9%.

you are viewing a single comment's thread
view the rest of the comments
[–] aluminium@lemmy.world -1 points 9 months ago (2 children)

Very mixed on this. If the compiler is for example using stuff like constexpr in C++ to do major calculations at compile time instead of at runtime then yeah its cheating.

But on the other hand if its doing some Microarchitecture specific optmizations like reordering instructions or replacing certain instructions with others - as long as these are available to the public its fair game i.m.o..

[–] Buffalox@lemmy.world 38 points 9 months ago* (last edited 9 months ago)

The article states that the compilation was tailored for this specific task, which means it doesn't represent how the CPU would normally perform it. So it's definitely cheating.
A benchmark is not supposed to be a compiler optimization competition. If they showed both, and revealed it was optimized, it would be another matter.

[–] Giooschi@lemmy.world 12 points 9 months ago

Even if the compiler was available to the public most software doesn't use it, so the benchmark is still not representative of real world performance.