Welcome to the first lesson of our course on managing data from different datasets. In today's digital world, it's common to encounter large volumes of data. Understanding how to efficiently manage this data, especially when it's compressed, is crucial. This lesson will focus on handling JSON files contained within a zip archive. By the end, you'll be able to extract, read, and process data stored in compressed formats, building a strong foundation for handling real-world datasets.

Before we dive into zip files, let's briefly recall some essentials about JSON and file I/O operations. JSON, or JavaScript Object Notation, is a lightweight data interchange format. It's easy for humans to read and write and easy for machines to parse and generate. In R, we interact with JSON data using the jsonlite package and its fromJSON and toJSON functions.

Zip files are a type of compressed file format that allows you to bundle many files into one. In R, you can work with zip files using the base function unzip(), which provides tools to handle zip files by extracting them to a directory.

Here's how you open a zip file and extract its contents using the unzip() function:

zip_file_name <- "universe_data.zip"
extract_dir <- tempdir()  # Use a temporary directory for extraction
unzip(zip_file_name, exdir = extract_dir)
print(paste("Zip File Extracted to:", extract_dir))

In this example:

• unzip(zip_file_name, exdir = extract_dir) is used to extract the zip file's contents to the specified temporary directory.

Once the zip file is open, you can list its contents using the unzip() function with the list = TRUE argument:

file_list <- unzip(zip_file_name, list = TRUE)
print("Files in the archive:")
print(file_list)

The unzip(list = TRUE) argument lists the contents of the zip file without extracting them. The returned data frame (file_list) contains file metadata, including names, sizes, and modification dates. Here is a sample representation of its structure:

Before we proceed with parsing data from the universe dataset, let’s discuss the data itself. The dataset contains information about various stars and is provided in a JSON format. Each entry in the data corresponds to a star with details like its name, type, and mass. For instance, the mass field may look like "90.45 × 10^30 kg", indicating the mass in scientific notation. Understanding the structure will help us process and analyze the data efficiently.

Now, let's move on to reading JSON files stored in the zip archive. We begin by extracting, then reading a specific file from the archive using the fromJSON method from the jsonlite package.

Here's how you access a JSON file within the zip:

library(jsonlite)

stars_file_path <- file.path(extract_dir, "stars.json")
stars <- fromJSON(stars_file_path)

In this code:

• file.path(extract_dir, "stars.json") constructs the full path to the stars.json file in the extracted directory.
• fromJSON(stars_file_path) reads the content of the JSON file and converts it into a data frame that we can work with in R.

In addition to JSON files, you might encounter other types of files within a zip archive. Reading text files can be done using the unzip() function, just as we did with JSON files. Here's an example of how to read a text file:

txt_file_path <- file.path(extract_dir, "data.txt")
content <- readLines(txt_file_path)
cat(content, sep = "\n")

Explanation:

• file.path(extract_dir, "data.txt") constructs the full path to the data.txt file in the extracted directory.
• readLines(txt_file_path) reads the contents of the text file as a vector of lines.

In addition to JSON and text files, you might encounter CSV files within a zip archive. Reading CSV files can also be done using the unzip() function, followed by read.csv() for parsing CSV data.

Here's how to read a CSV file:

csv_file_path <- file.path(extract_dir, "data.csv")
csv_data <- read.csv(csv_file_path)
print(csv_data)

Explanation:

• file.path(extract_dir, "data.csv") constructs the full path to the data.csv file in the extracted directory.
• read.csv(csv_file_path) reads the contents of the CSV file into a data frame.

In this lesson, you learned to use base R functions and the jsonlite package to manage data stored in compressed formats. Specifically, you explored how unzip() is utilized to extract and list files in a zip archive, and how fromJSON() reads JSON files, converting them into R objects. Additionally, you discovered that readLines() reads text files line by line, and read.csv() loads CSV data into R data frames.

These skills will be invaluable as you tackle more complex data handling tasks. Now, you're ready to apply these concepts in the upcoming practice exercises, where you'll get hands-on experience with data extraction and analysis from compressed datasets. Let's move forward with confidence.