PC Review Forums Newsgroups Microsoft Excel Microsoft Excel Setup Excel 's precision problem

Reply

Excel 's precision problem

 
Thread Tools Rate Thread
Old 13-11-2003, 09:18 AM   #1
chenj
Guest
 
Posts: n/a
Default Excel 's precision problem


Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's
implemention.ex:
in Excel :gammaln(4)=1.79175946908210000
but it is 1.791759469228055 in MATLAB and Mathematica !!
Same problem in function erf(),and so on!


Some one who know the detail??


Thank you !
  Reply With Quote
Old 13-11-2003, 09:32 AM   #2
Alan
Guest
 
Posts: n/a
Default Re: Excel 's precision problem


"chenj" <anonymous@discussions.microsoft.com> wrote in message
news:0c7b01c3a9c7$2103d070$a101280a@phx.gbl...
>
> Now I found Excel' precision is not very hign !
> May be there is some problem in some Excel funcion's
> implemention.ex:
> in Excel :gammaln(4)=1.79175946908210000
> but it is 1.791759469228055 in MATLAB and Mathematica !!
> Same problem in function erf(),and so on!
>


According to my version of excel (2000) it evaluates to:

1.7917594690821

Numerically equal to your quoted value of 1.79175946908210000 but
without the implicit level of precision that your trailing zeros might
carry.

I guess that you have to accept that it is only correct to 9 d.p.or 10
s.f. If you need more precision that that, you probably need to stick
to dedicated apps.

Alan.


  Reply With Quote
Old 13-11-2003, 10:02 AM   #3
chengj
Guest
 
Posts: n/a
Default Re: Excel 's precision problem


>-----Original Message-----
>
>"chenj" <anonymous@discussions.microsoft.com> wrote in

message
>news:0c7b01c3a9c7$2103d070$a101280a@phx.gbl...
>>
>> Now I found Excel' precision is not very hign !
>> May be there is some problem in some Excel funcion's
>> implemention.ex:
>> in Excel :gammaln(4)=1.79175946908210000
>> but it is 1.791759469228055 in MATLAB and Mathematica !!
>> Same problem in function erf(),and so on!
>>

>


hi
I don't know what you said.
would you told me more!

Thank you !
>According to my version of excel (2000) it evaluates to:
>
>1.7917594690821
>
>Numerically equal to your quoted value of

1.79175946908210000 but
>without the implicit level of precision that your

trailing zeros might
>carry.
>
>I guess that you have to accept that it is only correct

to 9 d.p.or 10
>s.f. If you need more precision that that, you probably

need to stick
>to dedicated apps.
>
>Alan.
>
>
>.
>

  Reply With Quote
Old 13-11-2003, 10:02 AM   #4
chengj
Guest
 
Posts: n/a
Default Re: Excel 's precision problem


>-----Original Message-----
>
>"chenj" <anonymous@discussions.microsoft.com> wrote in

message
>news:0c7b01c3a9c7$2103d070$a101280a@phx.gbl...
>>
>> Now I found Excel' precision is not very hign !
>> May be there is some problem in some Excel funcion's
>> implemention.ex:
>> in Excel :gammaln(4)=1.79175946908210000
>> but it is 1.791759469228055 in MATLAB and Mathematica !!
>> Same problem in function erf(),and so on!
>>

>


hi
I don't know what you said.
would you told me more!

Thank you !
>According to my version of excel (2000) it evaluates to:
>
>1.7917594690821
>
>Numerically equal to your quoted value of

1.79175946908210000 but
>without the implicit level of precision that your

trailing zeros might
>carry.
>
>I guess that you have to accept that it is only correct

to 9 d.p.or 10
>s.f. If you need more precision that that, you probably

need to stick
>to dedicated apps.
>
>Alan.
>
>
>.
>

  Reply With Quote
Old 13-11-2003, 10:02 AM   #5
chengj
Guest
 
Posts: n/a
Default Re: Excel 's precision problem


>-----Original Message-----
>
>"chenj" <anonymous@discussions.microsoft.com> wrote in

message
>news:0c7b01c3a9c7$2103d070$a101280a@phx.gbl...
>>
>> Now I found Excel' precision is not very hign !
>> May be there is some problem in some Excel funcion's
>> implemention.ex:
>> in Excel :gammaln(4)=1.79175946908210000
>> but it is 1.791759469228055 in MATLAB and Mathematica !!
>> Same problem in function erf(),and so on!
>>

>


hi
I don't know what you said.
would you told me more!

Thank you !
>According to my version of excel (2000) it evaluates to:
>
>1.7917594690821
>
>Numerically equal to your quoted value of

1.79175946908210000 but
>without the implicit level of precision that your

trailing zeros might
>carry.
>
>I guess that you have to accept that it is only correct

to 9 d.p.or 10
>s.f. If you need more precision that that, you probably

need to stick
>to dedicated apps.
>
>Alan.
>
>
>.
>

  Reply With Quote
Old 13-11-2003, 10:16 AM   #6
Alan
Guest
 
Posts: n/a
Default Re: Excel 's precision problem

Hi Chenj / Chengj

"chengj" <anonymous@discussions.microsoft.com> wrote in message
news:0aa301c3a9cd$39b63c60$a401280a@phx.gbl...
>
> hi
> I don't know what you said.
> would you told me more!
>
> Thank you !
>


Which part did you not understand?

Essentially, I am saying that excel is not a high precision
mathematical application.

If you need that level of precision, I think you'll need to use a
different tool.

Other opinions are welcome!

Alan.


  Reply With Quote
Reply



Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off