Welcome to the lesson on regression analysis, which plays a crucial role in statistical modeling and prediction. Regression analysis helps us understand relationships between variables by fitting a mathematical model to the data. In this lesson, you'll learn how to perform simple linear regression using SciPy. This lesson builds on your previous understanding of descriptive statistics, probability distributions, and correlation and will prepare you for further exploration of statistical methods.

To explore simple linear regression, we need datasets x and y, representing the independent and dependent variables, respectively. Here's the sample data we'll work with:

import numpy as np

# Sample data
x = np.array([1, 2, 3, 4, 5])
y = np.array([2, 1, 4, 3, 5])

In this example, x represents the independent variable whose values are [1, 2, 3, 4, 5], and y is the dependent variable with values [2, 1, 4, 3, 5]. The aim is to model the relationship between x and y.

Let's visualize the regression line along with the data points using Matplotlib:

import matplotlib.pyplot as plt

# Plotting the scatter plot and regression line
plt.scatter(x, y, label='Data points')
plt.plot(x, slope * x + intercept, color='red', label='Linear fit')
plt.xlabel('Independent Variable X')
plt.ylabel('Dependent Variable Y')
plt.legend()
plt.title('Simple Linear Regression')
plt.show()

Here's what happens in this code:

• The scatter function plots the data points.
• The plot function draws the regression line obtained from the linear regression analysis.
• Labels and title are added for clarity.

Here is the result:

Now, let's use the famous Iris dataset to perform simple linear regression with real data:

from sklearn.datasets import load_iris
import numpy as np
import matplotlib.pyplot as plt
from scipy import stats

# Load iris dataset
iris = load_iris()
x = iris.data[:, 0]  # sepal length
y = iris.data[:, 2]  # petal length

# Perform simple linear regression
slope, intercept, r_value, p_value, std_err = stats.linregress(x, y)

# Plotting the regression results
plt.scatter(x, y, label='Iris Data Points')
plt.plot(x, slope * x + intercept, color='red', label='Linear fit')
plt.xlabel('Sepal Length')
plt.ylabel('Petal Length')
plt.legend()
plt.title('Linear Regression on Iris Dataset')
plt.show()

In this example:

• We take the sepal length as the independent variable (x) and the petal length as the dependent variable (y).
• We apply the same process of calculating the regression using scipy.stats.linregress.

The resulting plot shows the regression line.

In this lesson, you've learned how to perform simple linear regression using SciPy. You explored practical steps to compute the regression line and visualize the relationship between two variables. Understanding regression analysis is essential for data-driven decision-making and predictive modeling.

As you move on to the practice exercises, apply these concepts to solve real-world problems where regression can provide insights. Keep practicing to strengthen your understanding, and look forward to more advanced topics in your learning journey.