Working with Dates and Times

Working with dates and times is crucial in data analysis. Imagine analyzing sales data over time to understand seasonal trends. To make sense of such data, you need to handle dates and times accurately.

Today's goals:

1. Convert columns with date info to datetime format, even if they are in different formats.
2. Extract specific components like the year from datetime data.
3. Perform basic datetime operations such as finding time differences and obtaining today's date.

By the end, you'll be comfortable manipulating dates and times in Pandas. Let's start!

Date info often comes as text, which isn't very useful for analysis. Converting this text to datetime format lets us use powerful features in Pandas.

The pd.to_datetime() function converts different date formats correctly. Here's an example:

import pandas as pd

# Sample data
data = {
    'order_date': ['2023-10-01', '10/02/2023', 'October 3 2023', '2023.10.04']
}
sales = pd.DataFrame(data)

# Convert 'order_date' to datetime
sales['order_date'] = pd.to_datetime(sales['order_date'], format='mixed')

print(sales)

Output:

  order_date
0 2023-10-01
1 2023-10-02
2 2023-10-03
3 2023-10-04

This example converts various date formats into datetime objects, making date operations easier. Note that you need to specify format='mixed', so format will be inferred for each element individually

With a column in datetime format, we can extract components like the year, month, or day using the .dt accessor. Here’s how to extract the year, month, and day:

# Extract year, month, and day from datetime
sales['year'] = sales['order_date'].dt.year
sales['month'] = sales['order_date'].dt.month
sales['day'] = sales['order_date'].dt.day

print(sales)

Output:

  order_date  year  month  day
0 2023-10-01  2023     10    1
1 2023-10-02  2023     10    2
2 2023-10-03  2023     10    3
3 2023-10-04  2023     10    4

This code creates new columns for the year, month, and day, which can be useful for time-based analyses like finding monthly or seasonal trends.

Pandas also allows for various datetime operations. For example, finding the time difference between two dates and obtaining today's date:

from datetime import datetime

# Calculate time delta
sales['time_since_order'] = datetime.now() - sales['order_date']

# Today's date
today = pd.to_datetime('today')

print(sales)
print('Today\'s date:', today)

Output:

  order_date  year  month  day     time_since_order
0 2023-10-01  2023     10    1      3 days 10:23:30.456789
1 2023-10-02  2023     10    2      2 days 10:23:30.456789
2 2023-10-03  2023     10    3      1 day  10:23:30.456789
3 2023-10-04  2023     10    4      0 days 10:23:30.456789
Today's date: 2023-10-05

This code calculates the time difference between each order date and the current date, as well as retrieves today's date.