Understanding Data Streams: Basics and Operations

Warm greetings! This lesson introduces data streams, which are essentially continuous datasets. Think of a weather station or a gaming application gathering data per second — both are generating data streams! We will master handling these data streams using Python, learning to access elements, slice segments, and even convert these streams into strings for easier handling.

In Python, data streams are commonly mirrored as lists. Python also facilitates additional data structures like tuples or dictionaries.

Consider a straightforward Python class named DataStream. This class encapsulates operations related to data streams in our program:

class DataStream:
    def __init__(self, data):
        self.data = data

To use it, we create a sample data stream as an instance of our DataStream class, where each element is a dictionary:

stream = DataStream([
    {"id": 1, "value": 100},
    {"id": 2, "value": 200},
    {"id": 3, "value": 300},
    {"id": 4, "value": 400},
])

To look into individual elements of a data stream, we use indexing. The get() method we introduce below fetches the i-th element from the data stream:

class DataStream:
    def __init__(self, data):
        self.data = data

    def get(self, i):
        return self.data[i]

Here, we can see the get() method in action:

stream = DataStream([
    {"id": 1, "value": 100},
    {"id": 2, "value": 200},
    {"id": 3, "value": 300},
    {"id": 4, "value": 400}
])

print(stream.get(2))  # It prints: {'id': 3, 'value': 300}
print(stream.get(-1)) # It prints: {'id': 4, 'value': 400}

In essence, stream.get(2) fetched us {'id': 3, 'value': 300} — the third element (since indexing starts from 0). At the same time, stream.get(-1) fetches the last element, which is {'id': 4, 'value': 400}.

Fetching a range of elements rather than a single one is facilitated by slicing. A slice data[i:j] crafts a new list containing elements from position i (inclusive) to j (exclusive) in the data stream. We introduce a slice() method to support slicing:

class DataStream:
    def __init__(self, data):
        self.data = data

    def get(self, i):
        return self.data[i]

    def slice(self, i, j):
        return self.data[i:j]

Here's a quick usage example:

stream = DataStream([
    {"id": 1, "value": 100},
    {"id": 2, "value": 200},
    {"id": 3, "value": 300},
    {"id": 4, "value": 400}
])

print(stream.slice(1, 3))  # It prints: [{'id': 2, 'value': 200}, {'id': 3, 'value': 300}]