Linear Regression Analysis

Lesson Introduction

Welcome to our lesson on Linear Regression Analysis! This technique is fundamental in machine learning for predicting values based on data. By the end of this lesson, you will understand what linear regression is, why it's useful, and how to create it using Python with the popular scikit-learn library. Imagine you're running a lemonade stand and want to predict future sales based on past data. Linear regression helps you figure out the trend and make educated guesses. Let's explore how it works.

Understanding Linear Regression

Linear regression models the relationship between two variables by fitting a straight line to the observed data. The simplest form is simple linear regression, where we have one independent variable (input) and one dependent variable (output).

Real-Life Example

Let's say you have the following data on hours studied and the corresponding test scores: Hours studied: [1, 2, 3, 4, 5] Test scores: [2, 4, 5, 4, 5] Our goal is to predict the test score for studying 6 hours. We'll start by visualizing the data: It is a scatter plot showing the relationship between hours studied and test scores. Now, let's introduce a line to approximate this relationship.

Plotting Multiple Lines

y = mx + c

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

Using scikit-learn to Calculate the Best-Fit Line

The best-fit line minimizes the error between the observed data points and the predicted values. We can use scikit-learn, a powerful machine learning library in Python, to find this line easily.

Let's calculate this in Python:

Python

from sklearn.linear_model import LinearRegression
import numpy as np

# Data for hours studied and test scores
X = np.array([1, 2, 3, 4, 5]).reshape(-1, 1)  # Reshaped for sklearn
y = np.array([2, 4, 5, 4, 5])

# Create a Linear Regression model
model = LinearRegression().fit(X, y)

# Calculate the slope (m) and intercept (c)
m = model.coef_[0]
c = model.intercept_

print(f'Calculated slope (m): {m}')  # Calculated slope (m): 0.6
print(f'Calculated intercept (c): {c}')  # Calculated intercept (c): 2.2

from sklearn.linear_model import LinearRegression
import numpy as np

# Data for hours studied and test scores
X = np.array([1, 2, 3, 4, 5]).reshape(-1, 1)  # Reshaped for sklearn
y = np.array([2, 4, 5, 4, 5])

# Create a Linear Regression model
model = LinearRegression().fit(X, y)

# Calculate the slope (m) and intercept (c)
m = model.coef_[0]
c = model.intercept_

print(f'Calculated slope (m): {m}')  # Calculated slope (m): 0.6
print(f'Calculated intercept (c): {c}')  # Calculated intercept (c): 2.2

This code will provide the slope and intercept for the best-fit line through the data points using scikit-learn. You will learn more about scikit-learn when you start exploring the Machine Learning. By now, let's quickly review this code:

LinearRegression() creates a linear regression model, which is capable of learning from the data and making predictions.
.fit(X, y) method trains the model, finding the perfect line coefficients.
.coef_[0] obtains the slope of the best-fit line. The reason we need to use [0] here is that a line could be multidimensional, so the model's .coef_ is a list of coefficients. In our two-dimensional case, we will get a list of one coefficient. To get it, we use [0].
.intercept_ obtains the intercept of the best-fit line.

Lesson Introduction

Understanding Linear Regression

Real-Life Example

Plotting Multiple Lines

Join the 1M+ learners on CodeSignal

Using scikit-learn to Calculate the Best-Fit Line

Plot the Line with the Data

Making Predictions for New Values

Lesson Summary