Calculate and Plot Correlations with Hue Using Scatterplots and Heatmaps

Hello and welcome! In today's lesson, we'll dive into the advanced technique of calculating and plotting correlations using hue in scatterplots and heatmaps, focusing on the diamonds dataset. These visualization methods will help you understand the relationships between multiple features in the dataset, enhancing your ability to derive insights for better decision-making.

Correlation analysis is essential in data science as it measures the relationship between two variables. Understanding these correlations helps in feature selection, understanding data relationships, and making predictive models more accurate.

• Pearson Correlation: Measures linear correlation.
• Spearman Correlation: Measures monotonic relationships.
• Kendall Correlation: Measures ordinal relationships.

In this lesson, we will focus on the Pearson correlation, which is commonly used for continuous data.

First, let's load the diamonds dataset and preprocess it by converting categorical variables into numerical values for easier plotting and analysis.

import seaborn as sns
import pandas as pd
import matplotlib.pyplot as plt

# Load the diamonds dataset
diamonds = sns.load_dataset('diamonds')

# Convert categorical variables for easier plotting
diamonds['cut'] = diamonds['cut'].astype('category').cat.codes
diamonds['color'] = diamonds['color'].astype('category').cat.codes
diamonds['clarity'] = diamonds['clarity'].astype('category').cat.codes

print(diamonds.head())

By converting cut, color, and clarity into numerical codes, we make these features easier to handle when plotting and calculating correlations.

The output of the above code will be:

   carat  cut  color  clarity  depth  table  price     x     y     z
0   0.23    0      1        6   61.5   55.0    326  3.95  3.98  2.43
1   0.21    1      1        5   59.8   61.0    326  3.89  3.84  2.31
2   0.23    3      1        3   56.9   65.0    327  4.05  4.07  2.31
3   0.29    1      5        4   62.4   58.0    334  4.20  4.23  2.63
4   0.31    3      6        6   63.3   58.0    335  4.34  4.35  2.75

This output displays the first five rows of the diamonds dataset after converting cut, color, and clarity into numerical codes, making it ready for correlation analysis and plotting.