 |
|
List Archives >
Mathcad List Archive >
Archive by date >
This Month By Date >
This Month By Topic
[mathcad] Rounding up/down error
| [mathcad] Rounding up/down error |
|
Author: Sander Lablans
Posted: Tue, 15 Jul 2003 09:10:40 +0200
|
Hello list,
I have been using a calculation with a number of 0.04425 N/mm^2. However, I
noticed a strange behavior when I modified the properties of a result to
show me 4 digits. Normally, it would then show me 0.0443 as a 5 always
rounds up. However, as you can see in the attached mathcad-sheet, MathCad
decides that it does not want to show 0.0443, but 0.0442. I have been
playing with a few other numbers, but this is the only one I have found. Can
someone tell me, whether this is a bug in MathCad, or that there is an
option included in MathCad that makes sure that some results are rounded to
a different value? (Or perhaps someone else has encountered the same
rounding error somewhere else...)
Regards,
Sander Lablans
---------------------------------
NedTech Engineering B.V.
The Netherlands
---
The Mathcad List - Discussion, Support & News
Contributions: />
Hosted by: Adept Scientific http://www.adeptscience.com
List Archive: http://lists.adeptscience.co.uk/
---
Would you like this to come to a different email address?
---
Simply leave the mailing list (see below) and re-join by
sending a blank email from the new address to:
or
---
If you do not want to be on the Mathcad list, simply send a
blank email (no subject or message needed) to:
/>
|
| [mathcad] Rounding up/down error |
|
Author: Sander Lablans
Posted: Tue, 15 Jul 2003 09:12:02 +0200
|
[Edit] and now with attachment... [Edit]
Hello list,
I have been using a calculation with a number of 0.04425 N/mm^2. However, I
noticed a strange behavior when I modified the properties of a result to
show me 4 digits. Normally, it would then show me 0.0443 as a 5 always
rounds up. However, as you can see in the attached mathcad-sheet, MathCad
decides that it does not want to show 0.0443, but 0.0442. I have been
playing with a few other numbers, but this is the only one I have found. Can
someone tell me, whether this is a bug in MathCad, or that there is an
option included in MathCad that makes sure that some results are rounded to
a different value? (Or perhaps someone else has encountered the same
rounding error somewhere else...)
Regards,
Sander Lablans
---------------------------------
NedTech Engineering B.V.
The Netherlands
|
|
Attachments:
Example.mcd
|
Previous by date: [mathcad] Axum function princomp, Bruff, Stuart
Next by date: [mathcad] Rounding up/down error, Sander Lablans
Previous thread: [mathcad] Re: SV: Display Problem with multiple lines on lhs of
on error statement, Stuart Bruff
Next thread: [mathcad] Rounding up/down error, Sander Lablans
|
|
|
RSS Feeds
Migration Guide