Descriptive Statistics

Welcome to our lesson on Descriptive Statistics! In this lesson, we will learn how to summarize and describe important features of a data set. By the end, you'll know how to calculate measures like the mean and standard deviation, which are crucial for understanding data in machine learning and many other fields.

Descriptive statistics help us get a quick overview of large amounts of data. Imagine understanding the average test scores of students or the variability in their heights. Descriptive statistics provide the tools for this efficiently.

The mean is the average of a set of numbers. Imagine test scores: 80, 85, 90, 75, and 95. To find the mean:

1. Add the scores: $80 + 85 + 90 + 75 + 95 = 425$
2. Divide by the number of scores: $\frac{425}{5} = 85$

The mean score is 85. It gives us the "central" value.

The standard deviation measures how spread out numbers are. For our test scores example:

1. Find the mean score: 85.
2. Subtract the mean from each score and square the result:
   • $(80 - 85)^2 = 25$
   • $(85 - 85)^2 = 0$
   • $(90 - 85)^2 = 25$
   • $(75 - 85)^2 = 100$
   • $(95 - 85)^2 = 100$
3. Find the average of these squared differences:
   • $\frac{25 + 0 + 25 + 100 + 100}{5} = 50$
4. Take the square root: $\sqrt{50} \approx 7.07$

A standard deviation of about 7.07 tells us the scores vary on average by 7.07 points from the mean. Low standard deviation means data points are close to the mean, while high indicates they are spread out.

The median is another measure of central tendency that represents the middle value of a data set when it is arranged in order. It is particularly useful when the data set contains outliers, as the median is not affected by extreme values.

For example, consider the test scores: 75, 80, 85, 90, and 95. To find the median:

1. Arrange the scores in order: 75, 80, 85, 90, 95
2. Find the middle score: 85

If the data set contains an even number of values, the median is the average of the two middle numbers.

For instance, with scores: 75, 80, 85, and 95:

1. Arrange in order: 75, 80, 85, 95
2. Find the middle scores: 80 and 85
3. Calculate their average: $\frac{80 + 85}{2} = 82.5$

The median is useful in situations where the mean might be misleading due to outliers or skewed data distributions.