List Archives >
Mathcad List Archive >
Archive by date >
This Month By Date >
This Month By Topic
[mathcad] Re: 6 decimal place precision
| [mathcad] Re: 6 decimal place precision |
|
Author: Jean Rosenfeld
Posted: Mon, 28 Jul 2003 16:33:00 +0100
|
For floating point numbers greater than 10 the proposed truncation method
will not reduce the number of carried decimal places to 6, which is what I
understand you want. You need first to divide |z| by factors of 10 until its
less than 10, then truncate, then multiply back by the factors of 10 that
you divided by. Try the attached.
--------------------------------------------------------
Jean L.J. Rosenfeld
Argoed Hall
Bryn-y-Baal
Mold
Flintshire CH7 6SQ
Wales, UK
Tel +44 1352 750566
E-mail />
-----Original Message-----
From: Bill Dumke
Sent: 28 July 2003 01:05
To: Mathcad Discussion List
Subject: [mathcad] Re: 6 decimal place precision
Sven,
I tried your method and thought it might work if I truncated the result of
every piece of the whole function. But I found it will not work for
floating point complex numbers. Any ideas? See attached file.
Bill
|
|
Attachments:
ctruncate3.mcd
|
[View Complete Thread]
Previous by date: [mathcad] Re: Multiprocessor system, Quang-Viet Nguyen
Next by date: [mathcad] Minimizing a Function, Chris Wilkinson
Previous thread: [mathcad] Multiprocessor system, Zdenek Sedlacek
Next thread: [mathcad] Minimizing a Function, Chris Wilkinson
|
RSS Feeds
and Mathcad Prime 1.0