Open main menu
Home
Random
Recent changes
Special pages
Community portal
Preferences
About Wikipedia
Disclaimers
Incubator escapee wiki
Search
User menu
Talk
Dark mode
Contributions
Create account
Log in
Editing
Microsoft Excel
(section)
Warning:
You are not logged in. Your IP address will be publicly visible if you make any edits. If you
log in
or
create an account
, your edits will be attributed to your username, along with other benefits.
Anti-spam check. Do
not
fill this in!
=== Numeric precision === {{main|Numeric precision in Microsoft Excel}} [[File:Excel fifteen figure.PNG|thumb|390px|Excel maintains 15 figures in its numbers, but they are not always accurate: the bottom line should be the same as the top line.]] Despite the use of 15-figure precision, Excel can display many more figures (up to thirty) upon user request. But the displayed figures are ''not'' those actually used in its computations, and so, for example, the difference of two numbers may differ from the difference of their displayed values. Although such departures are usually beyond the 15th decimal, exceptions do occur, especially for very large or very small numbers. Serious errors can occur if decisions are made based upon automated comparisons of numbers (for example, using the Excel ''If'' function), as equality of two numbers can be unpredictable.{{citation needed|date=August 2016}} In the figure, the fraction 1/9000 is displayed in Excel. Although this number has a decimal representation that is an infinite string of ones, Excel displays only the leading 15 figures. In the second line, the number one is added to the fraction, and again Excel displays only 15 figures. In the third line, one is subtracted from the sum using Excel. Because the sum in the second line has only eleven 1's after the decimal, the difference when 1 is subtracted from this displayed value is three 0's followed by a string of eleven 1's. However, the difference reported by Excel in the third line is three 0's followed by a string of ''thirteen'' 1's and two extra erroneous digits. This is because Excel calculates with about half a digit more than it displays. Excel works with a modified 1985 version of the [[IEEE 754-2008|IEEE 754 specification]].<ref name="microsoft_spec">Microsoft's overview is found at: {{cite web|url=http://support.microsoft.com/kb/78113/en-us|title=Floating-point arithmetic may give inaccurate results in Excel|work=Revision 8.2; article ID: 78113|publisher=Microsoft support|date=June 30, 2010|access-date=July 2, 2010|archive-date=May 14, 2011|archive-url=https://web.archive.org/web/20110514172904/http://support.microsoft.com/kb/78113/EN-US|url-status=live}}</ref> Excel's implementation involves conversions between binary and decimal representations, leading to accuracy that is on average better than one would expect from simple fifteen digit precision, but that can be worse. See the main article for details. Besides accuracy in user computations, the question of accuracy in Excel-provided functions may be raised. Particularly in the arena of statistical functions, Excel has been criticized for sacrificing accuracy for speed of calculation.<ref name="Altman"> {{cite book|title=Numerical issues in statistical computing for the social scientist|last1=Altman|first1=Micah|author-link1=Micah Altman|last2=Gill|first2=Jeff|author-link2=Jeff Gill (academic)|last3=McDonald|first3=Michael|year=2004|publisher=Wiley-IEEE|isbn=978-0-471-23633-7|chapter-url=https://books.google.com/books?id=j_KevqVO3zAC&pg=PA12|chapter=Β§2.1.1 Revealing example: Computing the coefficient standard deviation|page=12}} </ref><ref name="deLevie2">{{cite book|first=Robert|last=de Levie|title=''cited work''|isbn=978-0-19-515275-3|year=2004|pages=45β46|publisher=Oxford University Press}}</ref> As many calculations in Excel are executed using VBA, an additional issue is the accuracy of VBA, which varies with variable type and user-requested precision.<ref name="John_Walkenbach_0"> {{cite book|title=Excel 2010 Power Programming with VBA|chapter=Defining data types|pages=198 ''ff'' and Table 8β1|isbn=978-0-470-47535-5|first=John|last=Walkenbach|year=2010|publisher=Wiley|chapter-url=https://books.google.com/books?id=dtSdrjjVXrwC&pg=PA198}}</ref>
Edit summary
(Briefly describe your changes)
By publishing changes, you agree to the
Terms of Use
, and you irrevocably agree to release your contribution under the
CC BY-SA 4.0 License
and the
GFDL
. You agree that a hyperlink or URL is sufficient attribution under the Creative Commons license.
Cancel
Editing help
(opens in new window)