List Archives >
Mathcad List Archive >
Archive by date >
This Month By Date >
This Month By Topic
[mathcad] Re: Rounding up/down error
| [mathcad] Re: Rounding up/down error |
|
Author: Belshan, James E52
Posted: Wed, 16 Jul 2003 17:39:59 -0400
|
> Having said that, it does seem somewhat unfortunate that the
> convention used in MathCAD is somewhat obscure ...
Not to nit-pick, but this seems to be a little bit of a mis-statement. To
my understanding, MathCAD is programmed in a computer language, probably
C++. The programming language has a variety of variable types available,
which adhere to the IEEE standards. This is where you get the "round to the
even number" rule. MathCAD is not free to make its own rounding rules at
this level.
C++ (or whatever language it's written in) is not even to blame, really.
Since the computer uses binary, there are only certain numbers that it can
represent exactly (1/2, 1/4, 1/8, etc). So it may be that the closest
number it can store to 0.55 (for example only) is either 0.54999 or 0.55002,
leading to "anomalous" results.
What we need is for someone to invent a transistor with 10 states so we
could do normal "human" math.
James
---
The Mathcad List - Discussion, Support & News
Contributions: />
Hosted by: Adept Scientific http://www.adeptscience.com
List Archive: http://lists.adeptscience.co.uk/
---
Would you like this to come to a different email address?
---
Simply leave the mailing list (see below) and re-join by
sending a blank email from the new address to:
or
---
If you do not want to be on the Mathcad list, simply send a
blank email (no subject or message needed) to:
/>
|
[View Complete Thread]
Previous by date: [mathcad] Re: Rounding up/down error, Jean Rosenfeld
Next by date: [mathcad] Re: Rounding up/down error, Steve Ellison
Previous thread: [mathcad] [mathcad]Re: Rounding up/down error, Markos E Psarros
Next thread: [mathcad] Re: Rounding up/down error, Chris Whitford
|
RSS Feeds
and Mathcad Prime 1.0