CyberSlug Rules!

Beginner Programming CMPS060

Prof. Paulo Franca

Home

Syllabus

Login

Objects

Download

Staff only

Precision:

Computers cannot store arbitrarily long numbers.
Instead, floating point numbers are kept in two parts:
  • the mantissa - 6 or more digits
  • the exponent - the power of ten (or two)
  • float, double, long double
example:
6.022 x 10 to the 23th (avogadro's number)
or .6022 x 10 to the 25th (normalized)
4 digits of precision
exponent:25
mantissa: 6022

with 6 digits precision, 1.000001 and 1.000000 are the same thing!