Multiple choice

When a number is rounded off to n decimal place, the magnitude of relative error does not exceeds

  1. 10 - n

  2. 10 - n + 1

  3. 0.5 ´ 10 - n + 1

  4. None of these

Reveal answer Fill a bubble to check yourself
C Correct answer
Explanation

When rounding to n decimal places, the maximum absolute error is 0.5 * 10^-n. The relative error is bounded by (0.5 * 10^-n) / |x|. The provided formula in C is a common textbook approximation for this bound.

Keep practicing — related questions