+ Reply to Thread
Results 1 to 2 of 2

Excel not calculating as it should

Hybrid View

  1. 10-19-2015, 08:28 AM #1
    markDuffy
    markDuffy is offline
    Forum Contributor
    Join Date
    03-25-2011
    Location
    London, England
    MS-Off Ver
    office 2021
    Posts
    318

    Excel not calculating as it should

    Hi Guys
    Excel not calculating as it should
    This is likely to be straight forward but I can’t figure it out.
    I have used SUBSTITUTE to move the minus symbol from the right to the left on the number ( taken from a PDF) and then convert it to numbers. Yet one of the calculations shown shows an incorrect answer. You can see looking at it that it is the correct answer and should return a Zero. I have copied using = to copy all the numbers and then run the same where I get a zero.
    I would love to know what I am missing as I don’t want to have everything copied.

    Thanks
    Mark
    Attached Files Attached Files
    Reply With QuoteRegister To Reply
  2. 10-19-2015, 08:42 AM #2
    MrShorty
    MrShorty is offline
    Forum Guru
    Join Date
    04-13-2005
    Location
    North America
    MS-Off Ver
    2002/XP, 2007, 2024
    Posts
    16,416

    Re: Excel not calculating as it should

    That looks like normal computer round off error. I suggest a discussion like this http://www.cpearson.com/Excel/rounding.htm to understand what is going on.

    Solution will depend on exactly what the problem is. The top of this column is labeled "check should =0". Because of this round off error, experienced programmers I know never test for "is this exactly equal to 0". They will test for "is round(a1,7)=0" or "is abs(a1)<1E-8" or some such test that properly accounts for round off error.
    Quote Originally Posted by shg
    Mathematics is the native language of the natural world. Just trying to become literate.
    Reply With QuoteRegister To Reply
+ Reply to Thread
« Previous Thread | Next Thread »

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Excel 2013 Formulas Show Zeros Instead Of Calculating. Works In Excel 2007-2010.
    By Onihonker in forum Excel Formulas & Functions
    Replies: 10
    Last Post: 08-20-2013, 01:02 PM
  2. Excel 2007 : Excel formula for calculating TAT minus weekends
    By TheManinSac in forum Excel Formulas & Functions
    Replies: 12
    Last Post: 01-24-2013, 06:56 PM
  3. [SOLVED] Calculating recurring date in following month, calculating # days in that period
    By Walterius in forum Excel Formulas & Functions
    Replies: 6
    Last Post: 09-06-2005, 01:05 AM
  4. [SOLVED] Calculating recurring date in following month, calculating # days in that period
    By Walterius in forum Excel Formulas & Functions
    Replies: 6
    Last Post: 09-06-2005, 12:05 AM
  5. Calculating recurring date in following month, calculating # days in that period
    By Walterius in forum Excel Formulas & Functions
    Replies: 6
    Last Post: 09-05-2005, 11:05 PM
  6. Calculating recurring date in following month, calculating # days in that period
    By Walterius in forum Excel Formulas & Functions
    Replies: 6
    Last Post: 09-05-2005, 10:05 PM
  7. Calculating recurring date in following month, calculating # days in that period
    By Walterius in forum Excel Formulas & Functions
    Replies: 6
    Last Post: 06-04-2005, 07:05 PM
  8. [SOLVED] CALCULATING WORKSHEETS (INCLUDING AGE CALCULATING SHEETS) FOR DOWNLOADING, GREAT FOR PENSIONS/LIFE INSURANCE CALCULATIONS!
    By RICHARD in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 03-15-2005, 10:06 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Forum Rules


Search Engine Friendly URLs by vBSEO 3.6.0 RC 1