List Archives >
Mathcad List Archive >
Archive by date >
This Month By Date >
This Month By Topic
[mathcad] RE: [mathcad]Re: Rounding up/down error
| [mathcad] RE: [mathcad]Re: Rounding up/down error |
|
Author: Bruff, Stuart
Posted: Tue, 15 Jul 2003 12:58:53 +0100
|
Sander
Does the attached file help any?
Both Axum and Matlab round the number down. Excel rounds it up.
Stuart
Stuart Bruff
Senior Systems Engineer
Studies Group
Alenia Marconi Systems Limited
Lyon Way, Frimley, Camberley, Surrey.
GU16 7EX
United Kingdom
GNET : 822-5604
Tel No: +44(0)1276-468604
EMAIL:
-----Original Message-----
From: Sander Lablans />
Sent: Tuesday, July 15, 2003 10:01
To: Mathcad Discussion List
Subject: [mathcad] RE: [mathcad]Re: Rounding up/down error
*** WARNING ***
This mail has originated outside your organization,
either from an external partner or the Global Internet.
Keep this in mind if you answer this message.
Well, the problem isn't that actually. I know about hidden digits. The fact
is that I DEFINED a variable with:
dp := 0.04425 N/mm^2
Therefore, I know that there are NO other digits after the 5. But for my
report, I have to use 4 digits instead of 5 (due to conformance throughout
the document). It was then that I found out about this strange occurence.
I do have to say that I think Chris does have the answer to this strange
behavior. I am no MathCad specialist, so I have to take his word for it that
MathCad uses a 52-bit normalised mantissa. But it would make sense.
In fact: if I change the value of 0.04425 to 0.05425 it is rounded to
0.0542, changing it to 0.06425, it gets rounded to 0.0643. If I change this
first non-zero digit from 0 to 9, I get a rather arbitrarily behavior of the
last digit, which would point to Chris' explanation.
Sander
********************************************************************
This email and any attachments are confidential to the intended
recipient and may also be privileged. If you are not the intended
recipient please delete it from your system and notify the sender.
You should not copy it or use it for any purpose nor disclose or
distribute its contents to any other person.
********************************************************************
|
|
Attachments:
Numeric Roundoff.mcd
|
[View Complete Thread]
Previous by date: [mathcad] RE: [mathcad]Re: Rounding up/down error, Markos E Psarros
Next by date: [mathcad] RE: [mathcad]Re: Rounding up/down error, Radovan P Omorjan
Previous thread: [mathcad] [mathcad]Re: Rounding up/down error, Markos E Psarros
Next thread: [mathcad] RE: [mathcad]Re: Rounding up/down error, Sander Lablans
|
RSS Feeds
and Mathcad Prime 1.0