Feature Scaling

Hey there! Today, we're going to learn about feature scaling. You might be wondering, what is feature scaling, and why should we care? Simply put, feature scaling is like making sure all the ingredients in your recipe are measured in the same unit. Imagine trying to mix pounds of flour and teaspoons of salt without converting one to the other — it wouldn't make sense, right?

Our goal is to understand why feature scaling is crucial in machine learning and to learn how to do it using Python and a library called SciKit Learn.

Feature scaling ensures that all your data features contribute equally when building a machine learning model. Without scaling, large values might dominate, leading to biased outcomes. For example, if predicting house prices, and one feature was in thousands (like square footage) and another in single digits (like the number of rooms), the model might overlook the smaller values just because they seem less relevant.

There are two common types:

1. Standardization: Transforms data to have a mean ($\mu$) of 0 and a standard deviation ($\sigma$) of 1.

   Formula: $z = \frac{x - \mu}{\sigma}$, where $x$ is the original feature value, $\mu$ is the mean of the feature, and $\sigma$ is the standard deviation of the feature.

2. Normalization: Rescales data to range between 0 and 1.

   Formula: $x' = \frac{x - \min(x)}{\max(x) - \min(x)}$, where $x$ is the original feature value, $\min(x)$ is the minimum value of the feature, and $\max(x)$ is the maximum value of the feature.

Today, we'll focus on both standardization using StandardScaler and normalization using MinMaxScaler from SciKit Learn.

Let's create a small sample dataset to see how feature scaling works.

import pandas as pd
from sklearn.preprocessing import StandardScaler, MinMaxScaler

# Sample dataset
data = {'Feature1': [1, 2, 3, 4], 'Feature2': [10, 20, 30, 40]}
df = pd.DataFrame(data)
print("Original DataFrame:")
print(df)

Output:

Original DataFrame:
   Feature1  Feature2
0         1        10
1         2        20
2         3        30
3         4        40

Before scaling, Feature1 ranges from 1 to 4, and Feature2 ranges from 10 to 40. Let's scale this dataset using StandardScaler.