Data Acquisition and Preparation

Welcome back! Now that we have revisited some essential R programming concepts, it's time to move forward. In this section, we will explore how to acquire and prepare data for analysis. This is an important step in any data science project because clean and well-prepared data is the backbone of meaningful analysis and accurate results.

In this lesson, you will gain hands-on experience with:

1. Creating Dummy Data Frames and Matrices: Learn how to create data structures in R, such as data frames and matrices, which are essential for data manipulation and analysis.
2. Data Cleaning: Understand how to handle missing values and remove duplicates to tidy up your datasets.
3. Basic Data Exploration: Explore techniques to summarize and investigate the structure and characteristics of your data.

To start, let's create some dummy data structures. We'll use both data frames and matrices to understand their similarities and differences.

# Creating a Data Frame
df <- data.frame(ID = 1:5, Name = c("John", "Jane", "Doe", "Smith", "Emily"), Score = c(85, 90, 88, 77, 95))

# Creating a Matrix
matrix_example <- matrix(1:9, nrow = 3, byrow = TRUE)

cat("Created Data Frame and Matrix\n")
print(df)
print(matrix_example)

• data.frame(...): This function creates a data frame. You specify column names followed by their respective values. For example, ID = 1:5 creates a column named 'ID' with values 1 to 5. Here, df is a data frame that contains IDs, Names, and Scores for five individuals.
• matrix(data, nrow, ncol, byrow): This function creates a matrix. The data argument provides the data to fill the matrix, nrow specifies the number of rows, and byrow indicates whether to fill the matrix by rows (default is FALSE). In this code, matrix_example is a 3x3 matrix filled with the numbers 1 through 9. You can see the difference in how the data is structured and accessed.

Creating data frames and matrices is essential for data manipulation and analysis in R.

Data often comes with missing values, which can lead to inaccurate analysis if not handled properly. Let's introduce a missing value in our data frame and then clean it.

# Introduce Missing Value
df_with_na <- df
df_with_na$Score[2] <- NA  # Introduce a missing value in the 'Score' column for the second row

# Remove Rows with Missing Values
df_clean <- na.omit(df_with_na)
cat("Cleaned Data Frame\n")
print(df_clean)

• df_with_na$Score[2] <- NA: This line sets the second entry of the 'Score' column to NA (missing value).
• na.omit(object): This function removes all rows containing NA values in the object you specify, which can be a vector, matrix, or data frame. Here, df_clean is the cleaned data frame without the rows containing missing values.

Handling missing values is crucial to ensure your data is accurate and analysis is reliable.