 |
|
List Archives >
Mathcad List Archive >
Archive by date >
This Month By Date >
This Month By Topic
[mathcad] RE: [mathcad]Re: Rounding up/down error
| [mathcad] RE: [mathcad]Re: Rounding up/down error |
|
Author: Chris Whitford
Posted: Wed, 16 Jul 2003 14:14:11 +0100
|
It would appear that the algorithm for displaying numbers, and for the
"round" function, are different. As another example, write
x:=0.32245
y:=x.10000
y=3225 (displayed with no decimal places)
y = 3.224 * 10^3 (general format)
However, I don't think this is a bug. One must never assume that any real
number is exact; there is always the possibility of rounding error. These
examples just highlight that in a very direct way.
Chris
At 14:13 16/07/2003 +0200, you wrote:
>I might missing something but consider this (Mcad 2001)
>If you define a variable x := 0.32245 and format the result
>(Format=>Result) with 4
>decimal places you will get
>x = 0.3224
>but if you take y := round(x,4) you will get
>y = 0.3225
>formating the result with more or equal to 4 decimal places.
>I consider this as a Mathcad problem.
+------------------------------------------------------------------+
+ Chris Whitford University of Leicester +
+ Research Fellow Space Research Centre +
+ Tel: +44 (0)116 252 3496 Physics and Astronomy Department +
+ Fax: +44 (0)116 252 2464 University Road +
+ email: LEICESTER LE1 7RH +
+ http://www.star.le.ac.uk/ UK +
+------------------------------------------------------------------+
---
The Mathcad List - Discussion, Support & News
Contributions: />
Hosted by: Adept Scientific http://www.adeptscience.com
List Archive: http://lists.adeptscience.co.uk/
---
Would you like this to come to a different email address?
---
Simply leave the mailing list (see below) and re-join by
sending a blank email from the new address to:
or
---
If you do not want to be on the Mathcad list, simply send a
blank email (no subject or message needed) to:
/>
|
[View Complete Thread]
Previous by date: [mathcad] RE: [mathcad]Re: Rounding up/down error, Radovan P Omorjan
Next by date: [mathcad] RE: Rounding up/down error, Fletcher, Ian
Previous thread: [mathcad] [mathcad]Re: Rounding up/down error, Markos E Psarros
Next thread: [mathcad] Re: Rounding up/down error, Chris Whitford
|
|
|
RSS Feeds
and Mathcad Prime 1.0