Skip to main content

Thread: LibreOffice Calc calculation errors


hello,

using libreoffice calc calculating numbers in recurrence relations , finding residues through modular arithmetic. finding results produced libreoffice calc erroneous. find out causes error , how can fixed.

forming numbers of recurrence relation, manually type in 2 numbers serve seeds. these numbers typed row 1 & 2, column a. rest of these integers calculated using formula a3=a1+a2 autofilling every subsequent row. residue calculated using b3=mod(a3,360) , again autofilling rest of entries. fine until row 75 have number 1304969544928660. 2 numbers in row 73 & 74 498454011879264 & 806515533049393. next number should 1304969544928657, why libreoffice calc produce 1304969544928660 instead?

thank you,
manas

because calc uses 32-bit floating point numbers in arithmetic type of calculation asking do, , exceeding significant figure capability of 32 bit numbers. don't know of spreadsheet program perform type of integer arithmetic asking. can program in correct scientific programming language, not in spreadsheet.

know capability of tools.


Forum The Ubuntu Forum Community Ubuntu Official Flavours Support New to Ubuntu [ubuntu] LibreOffice Calc calculation errors


Ubuntu

Comments

Popular posts from this blog

Could not place because the source rectangle is empty

Thread: Using smartcard reader with vpnc

Adobe Font Folio 7.0 or just 7?