Inconsistent "greater than" and "less than" calculations

[wpryan]

Hello, I have a column of cells into which I want to calculate some basic pass/fail criteria based on this formula

=IF(ISBLANK(C28),"",IF(D28>0.1,"Fail","Pass"))

The data for D28 is coming from another calculation, which is working correctly. If the result of the calculation is exactly 0.1, then most of the time I get a "Pass" return - which is incorrect (0.1 is not greater than 0.1). I say most of the time because although it happens this way most of the time, there are certain cells which give the correct answer.


..any idea what's going on?

 

[wpryan]

...Strange. I rounded to 3 decimal places (don't need any more than that) and it's now working normally.Thanks for your help with this weird problem!

 

[Rick Rothstein]

...Strange. I rounded to 3 decimal places (don't need any more than that) and it's now working normally.

Any rounding as long as it is before the point at which decimal-to-binary starts to show a difference will work... I suggested 10 decimal places because I did not know your needs significant digits-wise.