Welcome to Evaluating Risk Claims in Real Life! In the first three lessons of this course, you learned how to turn small probabilities into concrete counts, distinguish absolute risk from relative risk, and see how repeated exposure can quietly increase danger over time. In this lesson, you will learn to:

• Identify the most common ways real-world risk claims mislead by leaving out key context, such as base rates, denominators, comparison groups, or timeframes.
• Interpret risk and test claims more accurately by checking base rates, absolute versus relative framing, and the quality of the sample or population behind the numbers.
• Apply a five-question checklist to judge whether a headline, health warning, or product claim is well-supported, incomplete, or misleading.

Imagine reading this headline: "New supplement cuts heart disease risk by 50%!" It sounds impressive — the kind of number that might make someone reach for a credit card on the spot. But by the end of this lesson, your first instinct will be to ask a series of pointed questions, questions that often reveal a very different picture behind the bold numbers. That habit of pausing and probing before reacting is exactly what this lesson is designed to build.

The most common way a risk claim misleads is not by lying, but by leaving things out. A number in a headline looks precise and objective, yet it can be almost meaningless without the right context. Here are three patterns worth memorizing:

• Missing base rate. A claim says risk is "doubled," but doubled from what? If the original risk was $1$ in $10{,}000$, doubling it to $2$ in $10{,}000$ is a tiny absolute change. Without the starting number, you cannot judge the real impact.
• Missing denominator or sample size. "9 out of 10 dentists recommend…" sounds powerful, but if only $$ dentists were surveyed, those carry far less weight than if were asked. The size and selection of the group matters enormously.

The base rate — how common a condition is in the first place — has a huge effect on how you should interpret a positive test result. This idea becomes especially important when risk claims cite screening tests or diagnostic accuracy.

Let's walk through a concrete example using natural frequencies — a way of expressing probabilities as simple counts in a large group, such as "90 out of 10,000 people," rather than as abstract percentages — because they make the math much easier to see.

Suppose a medical condition affects $1$ in every $100$ people. A screening test has a sensitivity of $90\%$ (it correctly flags $90\%$ of those who truly have the condition) and a specificity of $95\mathrm{\%}$ (it correctly clears of those who do not). Now picture people being tested:

You now have enough tools to evaluate almost any everyday risk claim. The following checklist pulls together skills from across this course and the broader learning path into a single, repeatable process:

1. What is the base rate? How common is the event or condition before the claim enters the picture? A "50% increase" means very different things depending on whether the starting risk is $1\%$ or $20\%$.
2. Is the risk given as absolute or relative? As covered previously, relative risk can make small changes sound dramatic. Always look for the absolute numbers behind the percentage.
3. What is the sample or population? Was the study large or small? Was the group representative of the people the claim is aimed at? As you saw in earlier courses, small samples can produce extreme results purely by chance.
4. What information is missing? Check for absent denominators, omitted comparison groups, or unspecified timeframes. If key context is missing, the claim is incomplete at best.
5. Does the overall picture hold up? Combine everything above into a final judgment: is the claim well-supported, merely incomplete, or actively misleading?

Think of these five questions as a mental filter. Most solid claims survive all five checks without trouble; most misleading ones stumble on at least one or two.

Let's put the full checklist to work on a realistic headline:

"Study finds high-dose Vitamin Z reduces cancer risk by 40%!"

Step 1 — Base rate. What kind of cancer, and how common is it? Suppose the relevant cancer affects about $8$ in $1{,}000$ people over ten years, giving a baseline risk of $0.8\%$.

Step 2 — Absolute vs. relative risk. The "40%" in the headline is a relative reduction. A $40\%$ cut from $0.8\%$ gives an absolute drop of:

In this lesson, you built a practical framework for evaluating real-world risk claims. You identified the most common missing-information patterns — absent base rates, hidden denominators, and unclear comparison groups — and revisited how base rates shape the meaning of test results, using natural frequencies to reveal that even "accurate" tests can produce mostly false alarms when a condition is rare. Finally, you assembled a five-question checklist that integrates skills from this entire learning path: checking base rates, distinguishing absolute from relative risk, questioning the sample, spotting missing context, and arriving at an informed judgment.

This is the final lesson of both the course and the full learning path, so you now have every concept you need to think clearly about probability and risk in everyday life. Up next are the practice exercises, where you will dissect headlines, catch misleading statistics, and write your own complete evaluations from scratch. Time to show what a well-trained critical eye can do!