Bug 62644
Summary: | math addition and subtraction errors | ||
---|---|---|---|
Product: | [Retired] Red Hat Linux | Reporter: | Craig <craig> |
Component: | gnome-utils | Assignee: | Havoc Pennington <hp> |
Status: | CLOSED CURRENTRELEASE | QA Contact: | Brian Brock <bbrock> |
Severity: | medium | Docs Contact: | |
Priority: | medium | ||
Version: | 7.2 | ||
Target Milestone: | --- | ||
Target Release: | --- | ||
Hardware: | i386 | ||
OS: | Linux | ||
Whiteboard: | |||
Fixed In Version: | Doc Type: | Bug Fix | |
Doc Text: | Story Points: | --- | |
Clone Of: | Environment: | ||
Last Closed: | 2002-04-10 15:00:04 UTC | Type: | --- |
Regression: | --- | Mount Type: | --- |
Documentation: | --- | CRM: | |
Verified Versions: | Category: | --- | |
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
Cloudforms Team: | --- | Target Upstream Version: | |
Embargoed: |
Description
Craig
2002-04-03 18:14:20 UTC
Floating point math isn't exact - you can't represent an infinite range (R - all real numbers) in a finite space of 2^(precision) combinations. Thus, don't count on having a specific number when you have done a series of numerical calculations. This is especially a problem with 0, as if it was 1+1e-20, the last part would be truncated when displayed. In perl/php this is entirely normal and expected, that's how floating point calculations work, they have limited precision. The calculator app should work around it though, bug filed upstream here: http://bugzilla.gnome.org/show_bug.cgi?id=78292 Closing on Red Hat level. |