Working with DateTime Features in Pandas | CodeSignal Learn

Working with DateTime Features in Pandas | CodeSignal Learn

Introduction

In this lesson, we will explore how to work with DateTime features in Pandas . Understanding how to manipulate date and time data is an essential skill, especially when dealing with time series data or performing date-based computations. We'll learn how to add and convert date columns in a DataFrame, extract useful features such as the year, month, and day of the week, thereby enhancing our data analysis capabilities.

Handling DateType Data in Pandas

DateTime features play a crucial role in data analysis. They allow us to track changes over time, identify trends, manage schedules, and organize data chronologically. Proper handling of date and time data enables businesses to make data-driven decisions, improve forecasting accuracy, and streamline operations that depend on timing. When dealing with date and time data in Pandas, it’s important to convert date values into the datetime data type. This conversion allows us to perform calculations and extract components of the date with ease. Pandas provides various functions and methods to manage DateTime features effectively. A common scenario is having date information stored as strings. Before performing any DateTime operations, these strings must be converted into datetime objects.

Adding and Converting Date Columns

Let's start by creating a DataFrame with a column of date values stored as strings. We'll then convert this column to the datetime format. Pythonimport pandas as pd # Create a DataFrame with 'Date_of_Joining' as string type df = pd.DataFrame({ 'Name': ['Alice', 'Bob', 'Charlie', 'David', 'Eva'], 'Date_of_Joining': ['2022-05-14', '2020-06-30', '2019-07-15', '2021-08-22', '2018-09-10'] }) # Convert the 'Date_of_Joining' column to datetime format df['Date_of_Joining'] = pd.to_datetime(df['Date_of_Joining']) The to_datetime method in Pandas is a powerful tool for converting date strings into datetime objects. It is capable of parsing a wide variety of date formats, including yyyy-mm-dd, dd-mm-yyyy, mm-dd-yyyy, and more. By default, to_datetime will attempt to infer the format of the date strings. However, if the format is ambiguous or not automatically recognized, you can specify the format explicitly using the format parameter. For example, if your date strings are in the dd-mm-yyyy format, you can use: Pythondf['Date_of_Joining'] = pd.to_datetime(df['Date_of_Joining'], format='%d-%m-%Y') This ensures that the conversion is done correctly, especially when dealing with international date formats or when the default inference might lead to incorrect parsing.

Sign up

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

Extracting Date Features

Once we've transformed our date strings into datetime objects, we can extract various components like the year, month, and day of the week. This is useful for segmenting data by time periods or conducting analysis on specific time frames. # Extract year, month, and day of the week df['Year'] = df['Date_of_Joining'].dt.year df['Month'] = df['Date_of_Joining'].dt.month df['Day_of_Week'] = df['Date_of_Joining'].dt.day_name() The dt accessor lets us access different components of a datetime object efficiently.

Advanced DateTime Operations

Beyond basic extraction, Pandas supports advanced operations such as: Timedelta calculations - Calculate differences between dates, which can help understand business metrics like tenure or time-to-event. df['Days_Since_Joining'] = (pd.Timestamp('today') - df['Date_of_Joining']).dt.days pd.Timestamp is a Pandas equivalent of Python's datetime object, representing a single timestamp. It is used here to get the current date with pd.Timestamp('today') . Date offsets - Add or subtract periods like days, months, or years to/from dates. df['One_Year_Anniversary'] = df['Date_of_Joining'] + pd.DateOffset(years=1) Date offsets allow for easy manipulation of dates by adding or subtracting specific time periods, such as days, months, or years.