 |
|
List Archives >
Mathcad List Archive >
Archive by date >
This Month By Date >
This Month By Topic
[mathcad] RE: [mathcad]Re: Rounding up/down error
| [mathcad] RE: [mathcad]Re: Rounding up/down error |
|
Author: Radovan P Omorjan
Posted: Wed, 16 Jul 2003 14:13:56 +0200
|
Hi Sander and others,
I might missing something but consider this (Mcad 2001)
If you define a variable x := 0.32245 and format the result (Format=>Result) with 4
decimal places you will get
x = 0.3224
but if you take y := round(x,4) you will get
y = 0.3225
formating the result with more or equal to 4 decimal places.
I consider this as a Mathcad problem.
Radovan
On 15 Jul 2003 at 11:19, Chris Whitford wrote:
>
> This can lead to unexpected behaviour. Consider if the internal representation is 0.0442499999...
> Then to 4 places it will become 0.0442 while for 5 or more places it will become 0.0442500...
> and Mathcad drops the trailing zeroes. Try it!
>
> Chris
---
The Mathcad List - Discussion, Support & News
Contributions: />
Hosted by: Adept Scientific http://www.adeptscience.com
List Archive: http://lists.adeptscience.co.uk/
---
Would you like this to come to a different email address?
---
Simply leave the mailing list (see below) and re-join by
sending a blank email from the new address to:
or
---
If you do not want to be on the Mathcad list, simply send a
blank email (no subject or message needed) to:
/>
|
[View Complete Thread]
Previous by date: [mathcad] RE: [mathcad]Re: Rounding up/down error, Bruff, Stuart
Next by date: [mathcad] RE: [mathcad]Re: Rounding up/down error, Chris Whitford
Previous thread: [mathcad] [mathcad]Re: Rounding up/down error, Markos E Psarros
Next thread: [mathcad] RE: [mathcad]Re: Rounding up/down error, Sander Lablans
|
|
|
RSS Feeds
and Mathcad Prime 1.0