Introduction

Welcome back to Estimating and Comparing Real Numbers! We are now on the second lesson of this course, and you are building momentum nicely. In the previous lesson, we learned how to approximate irrational square roots by hand using the trial squaring method. That technique gave us a solid understanding of how decimal approximations are constructed, one careful step at a time.

In this lesson, we shift to a faster and more common scenario: a calculator has already done the heavy lifting and is showing us a long string of digits. Our job is to round that display to a specific precision, whether that is the nearest tenth, hundredth, or thousandth. This is a skill that shows up constantly in math courses, science labs, and everyday life, so let's make sure we can do it confidently.

From Building Decimals to Reading Them

Trial squaring, as we saw in Lesson 1, requires several rounds of squaring candidates and comparing gaps just to pin down two or three decimal places. That process is valuable because it shows us why the digits are what they are. In practice, though, we rarely need to construct those digits ourselves. A calculator, phone, or computer can produce ten or more decimal places of 5\sqrt{5}, π\pi, or ee in an instant.

Precision Levels: Tenths, Hundredths, and Thousandths

Before rounding anything, let's make sure the vocabulary is clear. Each decimal place has a specific name based on its position after the decimal point:

PositionNameExample digit in 3.14153.1415
1st decimal placeTenths11
2nd decimal placeHundredths44
3rd decimal placeThousandths11

When someone asks for a value "to the nearest tenth," they want one digit after the decimal point. "To the nearest hundredth" means two digits, and "to the nearest thousandth" means three digits. Keeping this mapping straight is half the battle.

Labeled diagram of decimal place value positions for the number 3.1415
The Rounding Rule

Rounding a long decimal to a target precision follows one simple rule. Look at the digit immediately after the last digit you want to keep:

  • If that digit is 5 or greater, round the last kept digit up by one.
  • If that digit is less than 5, leave the last kept digit as it is.

For example, suppose a calculator shows 7=2.6457513\sqrt{7} = 2.6457513\ldots and we need the value to the nearest hundredth. The hundredths digit is (the second decimal place), and the digit right after it is . Since , we round the up to , giving us .

Worked Example: Rounding Pi

Let's practice with a constant we encountered in earlier courses. A calculator shows:

π=3.14159265\pi = 3.14159265\ldots

To the nearest tenth: We keep one decimal place. The tenths digit is 11, and the next digit is 44. Since 4<54 < 5, we keep the .

Worked Example: Rounding e

Another important irrational constant is Euler's number, ee. A calculator displays:

e=2.71828182e = 2.71828182\ldots

Let's round it to each precision:

  • Tenths: The tenths digit is 77, and the next digit is 11. Since 1<51 < 5, we keep . Result: .
Applying Rounding to a Real-World Measurement

Imagine we are shopping for a TV and want to know its diagonal screen length. The screen measures 88 inches across and 55 inches tall, so by the Pythagorean theorem the diagonal is:

82+52=64+25=89\sqrt{8^2 + 5^2} = \sqrt{64 + 25} = \sqrt{89}
Common Mistakes to Avoid

A few errors come up frequently when rounding calculator displays. Being aware of them now will save you trouble in the practice exercises and beyond.

  • Rounding in stages. Never round to thousandths first and then use that result to round to hundredths. Always go back to the full calculator display for each requested precision. Rounding in stages can produce a different, incorrect answer.
  • Confusing decimal places with significant figures. "To the nearest hundredth" means exactly two digits after the decimal point, regardless of how many digits appear before it.
  • Dropping trailing zeros. If rounding 4.00284.0028 to the nearest hundredth gives 4.004.00, both zeros must stay. Writing just 44 changes the implied precision of the result.
Conclusion and Next Steps

In this lesson, we moved from the manual process of trial squaring to the quicker, everyday skill of reading a calculator display and rounding to a target precision. The method is straightforward: identify the last digit you need to keep, check the digit right after it, and decide whether to round up or stay put. We also looked at the special case of rounding a 9 and how it affects the digits to the left.

Now it is time to put this skill to the test! The upcoming practice exercises will have you reading a calculator display of 7\sqrt{7} and filling in rounded values at multiple precisions, rounding π\pi and on your own, and applying your rounding ability to a realistic TV screen measurement. Let's see how sharp those rounding instincts are!

Sign up
Join the 1M+ learners on CodeSignal
Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal