Re: Accuracy of Statistical Functions
- From: "Andreas J. Guelzow" <aguelzow taliesin ca>
- To: gnumeric-list gnome org
- Subject: Re: Accuracy of Statistical Functions
- Date: Fri, 10 Nov 2006 10:43:13 -0700
On Fri, 2006-10-11 at 11:10 -0500, Morten Welinder wrote:
...and for the sum I see
-1.11097e-5 -1.11106e-5 -1.11097e-5 -1.11097e-5 -1.11097e-5
Leonard is surely using 1.6.x where some of these values turn out to be
0.
Andreas
Which clearly shows that we aren't perfect, but on the other hand, we do not get
zero as you seem to.
--
Andreas J. Guelzow, Professor
Dept. of Mathematical & Computing Sciences
Concordia University College of Alberta
[
Date Prev][
Date Next] [
Thread Prev][
Thread Next]
[
Thread Index]
[
Date Index]
[
Author Index]
