Multiplication error

  • Thread starter Thread starter Guest
  • Start date Start date
G

Guest

I noticed that Excel 2003 calculates:
7.5*1.2=8.7 when the correct answer is 9.0. It did this as part of a
formula where the 1.2 answer came from calculating another set of numbers.
When I asked Excel to calculate this answer by simply inputting those two
numbers the correct answer of 9.0 came out. Does anyone have an answer as to
why it does that?!
 
I noticed that Excel 2003 calculates:
7.5*1.2=8.7 when the correct answer is 9.0. It did this as part of a
formula where the 1.2 answer came from calculating another set of numbers.
When I asked Excel to calculate this answer by simply inputting those two
numbers the correct answer of 9.0 came out. Does anyone have an answer as to
why it does that?!
Click to expand...

Decimal operations in the number from which one of your final
multipliers are derived?

MP-
 
The cell that contains 1.2 is probably rounded.

Select the cell, and click the Increase Decimal button on the toolbar.
Perhaps you'll see that it's 1.16
 
As you have stated that the 1.2 comes from another calculation it is likely
that the result of that calculation is actually something like 1.16. Excel is
displaying the number as 1.2 as you have the cell format set to show just one
decimal place. Try increasing the number of decimal places and see if it
makes more sense.

Hope this helps
Rowan
 
DeeJay said:
I noticed that Excel 2003 calculates:
7.5*1.2=8.7 when the correct answer is 9.0. It did this as part of a
formula where the 1.2 answer came from calculating another set of numbers.
When I asked Excel to calculate this answer by simply inputting those two
numbers the correct answer of 9.0 came out. Does anyone have an answer as
to why it does that?!
Click to expand...

In a word, round-off error. (Okay, that's two or threee words.)

The "1.2" that you see in some cell is not really 1.2.
It is probably close to 1.16. Format that cell with
6 or so decimal places, and you will see what I mean.
And by the way, the "8.7" is probably not 8.7.

If you want "1.2" to actually be 1.2, there are a couple
ways to make that happen. The "best" way is to change
the formula that results in "1.2" to =ROUND(formula,1).

Alternatively, there is a Tools / Options / Calculation
option to cause this for all calculations. But because
the affects the entire spreadsheet, it can have unexpected
consequences.
 
[email protected] said:
In a word, round-off error. (Okay, that's two or threee words.)

The "1.2" that you see in some cell is not really 1.2.
It is probably close to 1.16. Format that cell with
6 or so decimal places, and you will see what I mean.
And by the way, the "8.7" is probably not 8.7.

If you want "1.2" to actually be 1.2, there are a couple
ways to make that happen. The "best" way is to change
the formula that results in "1.2" to =ROUND(formula,1).

Alternatively, there is a Tools / Options / Calculation
option to cause this for all calculations. But because
the affects the entire spreadsheet, it can have unexpected
consequences.
Click to expand...

Thank you- I will do that and see what happens. Thanks for the answer!
 
Back
Top