Excel error in converting decimal to fraction

R

Raptor

In Excel 2007 I found that if I add the decimal equivalents of 1/2 and 1/16
(.5000 + .0625) I should get a fraction of 9/16. But, the displayed value is
4/7 which is off by approximately .009 Doesn't sound like much but this
would not be acceptable for someone who works as a machinist or die maker.

Here's what my cell formula looks like.
=(1/16) + (1/2)

Since the decimal equivalent of both of these fractions do not exceed 4
decimal places, I would think Excel should be able to figure out this is 9/16
exactly.

Anyone know why this happens?
 
T

Tone

In Excel 2007 I found that if I add the decimal equivalents of 1/2 and 1/16
(.5000 + .0625) I should get a fraction of 9/16.  But, the displayed value is
4/7 which is off by approximately .009   Doesn't sound like much but this
would not be acceptable for someone who works as a machinist or die maker..

Here's what my cell formula looks like.
=(1/16) + (1/2)

Since the decimal equivalent of both of these fractions do not exceed 4
decimal places, I would think Excel should be able to figure out this is 9/16
exactly.

Anyone know why this happens?

What format have you chosen for the answer? On 2003, you need to
choose the "up to two" or "Up to three" digits option. Looks like
you've restricted it to 1 digit and hence got 4/7.

T
 
N

Niek Otten

If you format the cell as Fraction, Up to two digits, you get your required 9/16

--
Kind regards,

Niek Otten
Microsoft MVP - Excel

| In Excel 2007 I found that if I add the decimal equivalents of 1/2 and 1/16
| (.5000 + .0625) I should get a fraction of 9/16. But, the displayed value is
| 4/7 which is off by approximately .009 Doesn't sound like much but this
| would not be acceptable for someone who works as a machinist or die maker.
|
| Here's what my cell formula looks like.
| =(1/16) + (1/2)
|
| Since the decimal equivalent of both of these fractions do not exceed 4
| decimal places, I would think Excel should be able to figure out this is 9/16
| exactly.
|
| Anyone know why this happens?
 
R

Ron Rosenfeld

In Excel 2007 I found that if I add the decimal equivalents of 1/2 and 1/16
(.5000 + .0625) I should get a fraction of 9/16. But, the displayed value is
4/7 which is off by approximately .009 Doesn't sound like much but this
would not be acceptable for someone who works as a machinist or die maker.

Here's what my cell formula looks like.
=(1/16) + (1/2)

Since the decimal equivalent of both of these fractions do not exceed 4
decimal places, I would think Excel should be able to figure out this is 9/16
exactly.

Anyone know why this happens?

The correct answer is in the cell.

What you are seeing is the result of your having formatted the cell to show
fractions with only a single digit in the denominator.
--ron
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top