Mastering DataFrame Grouping in Pandas

Hello! In this lesson, we will explore the concept of grouping in pandas. Grouping rows of a DataFrame is a powerful tool that allows you to aggregate rows based on the values in one or more columns of your data. For example, say you have a DataFrame representing all orders in an online store, where each row is an order. You could group the DataFrame by Customer_ID to glean data about particular shoppers. Similarly, if you have a school database where each row corresponds to a student, grouping by Grade_Level can streamline data analysis for each grade. We'll exemplify this operation using a straightforward DataFrame.

Let's work with a DataFrame of individuals, each characterized by attributes such as Name, Age, and City. Here is a simple example:

import pandas as pd
df = pd.DataFrame({
    "Name": ["Alex", "Bob", "Chloe", "Charlie", "Alex", "Charlie"],
    "Age": [12, 15, 28, 55, 21, 35],
    "City": ["New York", "Los Angeles", "Chicago", "Los Angeles", "New York", "New York"]
})

The groupby function in pandas is the basis of group operations. Imagine a pond filled with various types of fish. When different colored foods are dropped into the pond, every fish is drawn to a specific color. After some time, your pond will neatly sort into groups of each type of fish.

We take the same approach with our DataFrame. Using the pandas groupby method, we will group our data by City. Here's how it's done:

grouped = df.groupby("City")

Now, the grouped variable is a special pandas DataFrameGroupBy object that has divided our DataFrame into groups by city.

The DataFrameGroupBy object holds the groups created using groupby. It's like a dictionary: each key is a unique city from our City column, and the corresponding value for each key is a DataFrame comprising all rows with that city in the City column.

For instance, to view data for "New York" only, pandas offers the get_group function:

print(grouped.get_group("New York"))
'''Output:
      Name  Age      City
0     Alex   12  New York
4     Alex   21  New York
5  Charlie   35  New York
'''

And there you have it! The function returns a DataFrame containing only the individuals whose City is "New York".