![]() |
|
#1
|
|||
|
|||
![]() Quote:
Quote:
More accurately, the calculator is simply rounding (or truncating) to a different number of decimal places (or significant digits). [EDIT] And it might be a decimal calculator; that is, it might use decimal instead of binary representation internally. We can simulate the calculator result by doing the following in Excel: A1: 41048 A2: 1312319 A3: 895.33 A4: =ROUNDDOWN(A1/A2, 7) A5: =A4*A3 A4 displays 0.0312789, and A5 displays 28.004937537. Presumably, the calculator displays only 6 decimal places, truncating. What calculator did you use? Perhaps the number of decimal places (or significant digits) is configurable. |
#2
|
|||
|
|||
![]()
It's not a fancy calculator or anything. It's just your standard, no frills, no nothing but the most basic of unctions calculator. There is nothing you can customize about it. All you've got are the basic 10 numbers, add, subtract, multiply, divide, equals, square root, and the memory buttons. And a little solar panel and a screen. You know, one of the ones from back when life was simpler. I don't remember offhand how many digits it has. Either way, I made a completely new spreadsheet and scrapped the other. And I stick with the calculator on my iPhone or computer. So, "problem" solved. Ahaha. Thanks for taking the time t explain, though. I appreciate it!
![]() |
![]() |
Tags |
error, problem, round |
Thread Tools | |
Display Modes | |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
![]() |
billreed7 | Excel | 5 | 07-03-2016 06:43 PM |
Rounding to nearest 0.25 | Guloluseus | Excel | 5 | 10-27-2015 11:28 PM |
Rounding values inconsistent | required_username | Excel | 10 | 06-05-2014 05:35 AM |
![]() |
judicial85 | Excel | 1 | 08-28-2011 05:41 PM |
![]() |
markg2 | Excel | 6 | 05-26-2010 09:54 AM |