Welcome to another lesson, where we'll explore a fundamental technique in text data manipulation: reading files line-by-line using Go. In many real-world applications, processing data one line at a time is crucial for effective data management, particularly when dealing with large files like logs or data streams. By the end of this lesson, you'll understand how to efficiently read and process file data line-by-line using Go.

File handling can be accomplished in Go using the bufio package. Specifically, bufio.NewScanner provides a convenient method for reading files one line at a time. This scanner reads the file line by line, which is ideal for handling large files efficiently because it does not require the entire file to be loaded into memory:

• file: Refers to the opened file object.
• scanner.Scan(): Advances the scanner to the next line.
• scanner.Text(): Retrieves the current line from the scanner.

This approach is perfect for processing large text files line by line efficiently.

To read a file line by line in Go, use bufio.NewScanner and iterate through the lines using a for loop. Let's see this in action:

Here, bufio.NewScanner(file) reads lines from data.txt one by one. Each line is stored in the line variable and then printed to the console.

Imagine needing to process a set of numbers stored in a file — reading each integer and calculating their sum. This is a practical task you can accomplish using a combination of bufio.NewScanner and strconv.Atoi for integer parsing.

Assume numbers.txt contains:

The following code reads integers from this file and calculates their sum:

• Reading Numbers: Each line is parsed to an integer using strconv.Atoi(), ensuring safe conversion.
• Calculating Sum: The integers are added together in the totalSum variable.

After executing this code, the output displays the total sum of the numbers:

In this lesson, you gained the skills to read a text file line by line using Go — a fundamental technique for processing large datasets efficiently. You've learned to manage file I/O operations using the bufio.NewScanner method and how to handle each line effectively.

Now, you're ready to dive into practice exercises where you can apply these concepts and strengthen your understanding. Continue to build on these skills as we explore further parsing techniques in future lessons. Keep up the great work!