Microsoft Office Forums

Go Back   Microsoft Office Forums > >

Reply
 
Thread Tools Display Modes
  #1  
Old 08-22-2016, 12:15 PM
joeu2004 joeu2004 is offline Excel Seems to be Rounding Twice Rather Than Once Windows 7 32bit Excel Seems to be Rounding Twice Rather Than Once Office 2007
Advanced Beginner
 
Join Date: Aug 2016
Posts: 32
joeu2004 is on a distinguished road
Default



Quote:
Originally Posted by xor View Post
When I do your calculation in Excel I get:
=41048/1312319*895.33 = 28.0050093308
Quote:
Originally Posted by melissapete24 View Post
I pulled out the calculator and did the math again, and it is still saying 28.004937. But, I pulled out my iPhone and used that calculator, and it came out the same as what you got, as did the calculator on the computer. [....] How the heck is a CALCULATOR wrong?
It is not "wrong" per se. Ironically, it is the calculator, not Excel that is "rounding twice".

More accurately, the calculator is simply rounding (or truncating) to a different number of decimal places (or significant digits).

[EDIT] And it might be a decimal calculator; that is, it might use decimal instead of binary representation internally.

We can simulate the calculator result by doing the following in Excel:

A1: 41048
A2: 1312319
A3: 895.33
A4: =ROUNDDOWN(A1/A2, 7)
A5: =A4*A3

A4 displays 0.0312789, and A5 displays 28.004937537.

Presumably, the calculator displays only 6 decimal places, truncating.

What calculator did you use? Perhaps the number of decimal places (or significant digits) is configurable.
Reply With Quote
  #2  
Old 08-27-2016, 12:51 AM
melissapete24 melissapete24 is offline Excel Seems to be Rounding Twice Rather Than Once Windows 7 32bit Excel Seems to be Rounding Twice Rather Than Once Office 2013
Novice
Excel Seems to be Rounding Twice Rather Than Once
 
Join Date: Aug 2016
Posts: 4
melissapete24 is on a distinguished road
Default

It's not a fancy calculator or anything. It's just your standard, no frills, no nothing but the most basic of unctions calculator. There is nothing you can customize about it. All you've got are the basic 10 numbers, add, subtract, multiply, divide, equals, square root, and the memory buttons. And a little solar panel and a screen. You know, one of the ones from back when life was simpler. I don't remember offhand how many digits it has. Either way, I made a completely new spreadsheet and scrapped the other. And I stick with the calculator on my iPhone or computer. So, "problem" solved. Ahaha. Thanks for taking the time t explain, though. I appreciate it!
Reply With Quote
Reply

Tags
error, problem, round

Thread Tools
Display Modes


Similar Threads
Thread Thread Starter Forum Replies Last Post
Excel Seems to be Rounding Twice Rather Than Once Time Calc with rounding. billreed7 Excel 5 07-03-2016 06:43 PM
Rounding to nearest 0.25 Guloluseus Excel 5 10-27-2015 11:28 PM
Rounding values inconsistent required_username Excel 10 06-05-2014 05:35 AM
Excel Seems to be Rounding Twice Rather Than Once Standard Dev. Rounding - Excel judicial85 Excel 1 08-28-2011 05:41 PM
Excel Seems to be Rounding Twice Rather Than Once Federal financial rounding? markg2 Excel 6 05-26-2010 09:54 AM

Other Forums: Access Forums

All times are GMT -7. The time now is 11:50 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2025, vBulletin Solutions Inc.
Search Engine Optimisation provided by DragonByte SEO (Lite) - vBulletin Mods & Addons Copyright © 2025 DragonByte Technologies Ltd.
MSOfficeForums.com is not affiliated with Microsoft