this post was submitted on 06 Jul 2025
1285 points (98.5% liked)

Greentext

6777 readers
1175 users here now

This is a place to share greentexts and witness the confounding life of Anon. If you're new to the Greentext community, think of it as a sort of zoo with Anon as the main attraction.

Be warned:

If you find yourself getting angry (or god forbid, agreeing) with something Anon has said, you might be doing it wrong.

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] needanke@feddit.org 15 points 1 week ago* (last edited 1 week ago) (2 children)

(I don't think that was your teachers point at all, but) couldn't the different formulas have produced different rounding errors due to floating point percision?

[–] funkless_eck@sh.itjust.works 22 points 1 week ago (1 children)

Excel has a 15 point float, a quadrillionth, which should be enough for anything you were using excel for.

yeah because excel does rounding stuff automatically for you

try entering 0.1 + 0.2 - 0.1 - 0.2 == 0.0 in any programming language of your choice and see what happens.

[–] Blackmist@feddit.uk 14 points 1 week ago (1 children)

Doubtful, but if anything mine would be more accurate. Fewer calculation steps to lose precision on. I think most spreadsheet software fudges floating point precision anyway. A computer programmer may accept that 0.1+0.2 is not 0.3 but an accountant or mathematician would not be having it.

I think she was just shit at maths tbh. As a kid you sort of assume all the teachers know more than you about every subject, and that's not the case at all.

As a kid you sort of assume all the teachers know more than you about every subject, and that’s not the case at all.

same for chatgpt