Here's Part 2.
Quote:
Originally Posted by Greg McKaskle
The strange bug happens because by the time you have made it to the penny calculation, the remainder is no longer a full two cents. If you display it with about 15 digits of precision, it is truly just a bit below, so the node returns almost a full penny as a remainder. This is largely due to the fact that floats cannot store base ten fractions precisely. The mixup rounds the value so that the small cumulative error resets. A different fixup would be to convert the initial value to units of pennies instead of dollars.
Greg McKaskle
|
Thank you for explaining. So is this something that can be fixed by NI or just a quark in programming? I remember there was something similar last year with the equal function but that seems to have been fixed.