CIS 512 WEEK 3 ASSIGNMENT 1 NUMERICAL PRECISION
The storage and representation of numbers in a computer can lead to costly mistakes because of precision errors. When using floating point numbers, one must make sure that the correct number of digits is used in a calculation because rounding errors can produce values that lead to errors.
Comments
Content
CIS 512 WEEK 3 ASSIGNMENT 1 NUMERICAL PRECISION
The storage and representation of numbers in a computer can lead to costly mistakes because of precision errors. When using floating point numbers, one must make sure that the correct number of digits is used in a calculation because rounding errors can produce values that lead to errors.