Encoding Categorical Variables Using Python | CodeSignal Learn

Encoding Categorical Variables Using Python | CodeSignal Learn

Introduction

When working with data, you often encounter categorical variables . These are variables that contain label values rather than numeric values. In data analysis and machine learning, it's often necessary to convert these categorical values into a numerical format that algorithms can handle effectively. This transformation is known as encoding categorical variables. In this lesson, we'll explore how to encode categorical variables using Python with a simple example.

Importance of Encoding Categorical Variables

Encoding categorical variables is a crucial step in data preprocessing. Many machine learning algorithms require numerical inputs as they perform mathematical computations which only work with numbers. Failing to encode these variables can result in inaccurate models or errors during model training. Moreover, encoding also helps in maintaining the semantic meaning of data while converting it into a format suitable for computational purposes.

Types of Encoding Techniques

There are several techniques to encode categorical variables, including: Label Encoding : Each unique category value is assigned a numerical label. This method is simple but may not be suitable for ordinal relationships. Example: Original DataFrame: text ID Color 1 Red 2 Blue 3 Green 4 Blue 5 Red Label Encoded DataFrame: text ID Color Label_Encoded 1 Red 0 2 Blue 1 3 Green 2 4 Blue 1 5 Red 0 One-Hot Encoding : Each category value is transformed into a separate column with binary values. This ensures there’s no ordinal relationship assumed between categories. Example: One-Hot Encoded DataFrame: text ID Color Red Blue Green 1 Red 1 0 0 2 Blue 0 1 0 3 Green 0 0 1 4 Blue 0 1 0 5 Red 1 0 0 Ordinal Encoding : This is similar to label encoding but takes into account the order of categories. Example: Ordinal Encoded DataFrame (assuming Blue < Green < Red): text ID Color Ordinal_Encoded 1 Red 2 2 Blue 0 3 Green 1 4 Blue 0 5 Red 2 In this lesson, we will specifically focus on using a dictionary mapping to encode a binary categorical variable, which is a form of label encoding.

Sign up

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

Applying Label Encoding with Dictionary Mapping

Let's say we have a dataset with a Gender column containing the values Male and Female. We want to convert this column into a numerical format where Male is represented as 1 and Female is represented as 0. We can achieve this using a dictionary mapping. import pandas as pd # Creating a sample DataFrame df = pd.DataFrame({'Gender': ['Male', 'Female', 'Female', 'Male', 'Female']}) # Encoding categorical variables df['Gender_Encoded'] = df['Gender'].map({'Male': 1, 'Female': 0}) # Display the DataFrame print(df) Output: Gender Gender_Encoded 0 Male 1 1 Female 0 2 Female 0 3 Male 1 4 Female 0 Let's break down the code: Creating a DataFrame: We start by creating a DataFrame using the pandas library. The DataFrame contains a column named Gender, which we aim to encode. Encoding using map: We use the map method to replace each label in the Gender column based on our specified dictionary: {'Male': 1, 'Female': 0}. This dictionary tells Python to encode Male as 1 and Female as 0. Adding a new column: The new column Gender_Encoded is created and added to the DataFrame. This column contains the numerical representation of the Gender column, which can now be used for further analysis or as input into a machine learning algorithm.

Python

import pandas as pd

# Creating a sample DataFrame
df = pd.DataFrame({'Gender': ['Male', 'Female', 'Female', 'Male', 'Female']})

# Encoding categorical variables
df['Gender_Encoded'] = df['Gender'].map({'Male': 1, 'Female': 0})

# Display the DataFrame
print(df)