R-squared Metric

Hello! Today, we will learn about the R-squared metric, a vital measure in machine learning. Have you ever wondered how to measure how well your model fits the real data? That’s exactly what the R-squared metric helps with! By the end of this lesson, you'll understand what R-squared is, why it’s essential, and how to calculate it using Python.

What is R-squared (R²)?

Imagine you're predicting how the height of children changes with age. R-squared, also called the coefficient of determination, helps us understand how well our model explains this variability in height based on age.

The formula for R-squared is:

$R^2 = 1 - \frac{SS_{res}}{SS_{tot}}$, where:

• $SS_{res}$ is the sum of the squares of the residuals (errors): $SS_{res} = \sum_{i=1}^{n} (y_i - \hat{y}_i)^2$
• $SS_{tot}$ is the total sum of the squares (proportional to the variance of the data): $SS_{tot} = \sum_{i=1}^{n} (y_i - \bar{y})^2$

R-squared tells us what proportion of the variance in the dependent variable (e.g., height) is predictable from the independent variable (e.g., age). An R-squared value ranges from 0 to 1:

• $R^2 = 0$: The model explains none of the variability.
• $R^2 = 1$: The model explains all the variability.

Why is R-squared Important?

Think about predicting someone’s height based on their age. If your predictions are very close to the actual heights, your model does a good job. If predictions are off, your model needs improvement. R-squared gives you a single number to show how well your model performs.

Higher R-squared values mean the model better explains the variability of the target variable. For instance, a high R-squared value in a model predicting house prices means the model accurately predicts based on inputs like square footage and number of bedrooms.

If your model has an R-squared of 0.85, it tells you 85% of the variance in house prices is explained by your model.

Here’s how to calculate R-squared using Python. Let’s take a look at the code snippet first and explain it step-by-step.

from sklearn.metrics import r2_score
import numpy as np

# Sample regression dataset: True values
y_true = np.array([3.0, -0.5, 2.0, 7.0])
y_pred = np.array([2.5, 0.0, 2.0, 8.0])

r2 = r2_score(y_true, y_pred)
print(f"R-squared: {r2}")  # R-squared: 0.948

1. Importing Libraries: First, we import the function r2_score from the sklearn.metrics module. This tool makes calculating R-squared straightforward.

2. Calculating R-squared: Using the r2_score function with y_true and y_pred, we calculate the R-squared value

3. Displaying the Result: We print out the R-squared value