Introduction to RNNs for Multivariate Time Series with PyTorch

Introduction to RNNs for Multivariate Time Series with PyTorch | CodeSignal Learn

Introduction to RNNs for Multivariate Time Series

Welcome to the next step in your journey of handling multivariate time series with Recurrent Neural Networks (RNNs). In the previous lessons, you learned how to preprocess the Air Quality dataset and prepare it for RNN input. Now, we will focus on building and training an RNN model to predict Temperature (T) using multiple features from this dataset. RNNs are particularly well-suited for time series forecasting due to their ability to capture temporal dependencies in sequential data. By the end of this lesson, you will have a solid understanding of how to construct and train an RNN model for multivariate time series forecasting.

Quick Recap of Preprocessing Steps

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

Splitting Data into Training and Test Sets

Before training the RNN model, it's important to evaluate its performance on unseen data. To do this, we split our dataset into training and test sets. For time series data, we use the earlier portion for training and the later portion for testing to preserve the temporal order. Python # Define train/test split ratio train_ratio = 0.8 train_size = int(len(X) * train_ratio) # Split the data X_train, X_test = X[:train_size], X[train_size:] y_train, y_test = y[:train_size], y[train_size:] # Define train/test split ratio train_ratio = 0.8 train_size = int(len(X) * train_ratio) # Split the data X_train, X_test = X[:train_size], X[train_size:] y_train, y_test = y[:train_size], y[train_size:] Now, use X_train and y_train for training the model, and reserve X_test and y_test for evaluating its performance after training.

Building the RNN Model: Code Walkthrough

Let's walk through the code to define the RNN model using PyTorch. We will use torch.nn modules such as nn.RNN and nn.Linear to construct the model. Python import torch import torch.nn as nn class RNNModel(nn.Module): def __init__(self, input_size, hidden_size, output_size): super(RNNModel, self).__init__() self.rnn = nn.RNN(input_size, hidden_size, batch_first=True) self.fc = nn.Linear(hidden_size, output_size) def forward(self, x): out, _ = self.rnn(x) out = self.fc(out[:, -1, :]) # Use the last time step's output return out # Define model parameters input_size = len(features) hidden_size = 20 output_size = 1 # Instantiate the model model = RNNModel(input_size, hidden_size, output_size) import torch import torch.nn as nn class RNNModel(nn.Module): def __init__(self, input_size, hidden_size, output_size): super(RNNModel, self).__init__() self.rnn = nn.RNN(input_size, hidden_size, batch_first=True) self.fc = nn.Linear(hidden_size, output_size) def forward(self, x): out, _ = self.rnn(x) out = self.fc(out[:, -1, :]) # Use the last time step's output return out # Define model parameters input_size = len(features) hidden_size = 20 output_size = 1 # Instantiate the model model = RNNModel(input_size, hidden_size, output_size) In this code, we define an RNNModel class that inherits from nn.Module . The__init__method initializes an nn.RNN layer with 20 hidden units and a nn.Linear layer for the output. The forward method defines the forward pass, where the RNN processes the input sequences, and the final output is obtained from the last time step.

Compiling and Training the RNN Model

In PyTorch, training a model involves defining a loss function, an optimizer, and manually implementing the training loop. We will use the Adam optimizer and mean squared error (MSE) as the loss function, as they are commonly used for regression tasks. Pythonimport torch.optim as optim # Define loss function and optimizer criterion = nn.MSELoss() optimizer = optim.Adam(model.parameters(), lr=0.001) # Convert training data to PyTorch tensors X_train_tensor = torch.tensor(X_train, dtype=torch.float32) y_train_tensor = torch.tensor(y_train, dtype=torch.float32) # Training loop epochs = 10 batch_size = 16 for epoch in range(epochs): model.train() for i in range(0, len(X_train_tensor), batch_size): X_batch = X_train_tensor[i:i+batch_size] y_batch = y_train_tensor[i:i+batch_size] # Forward pass outputs = model(X_batch) loss = criterion(outputs, y_batch) # Backward pass and optimization optimizer.zero_grad() loss.backward() optimizer.step() print(f'Epoch [{epoch+1}/{epochs}], Loss: {loss.item():.4f}')import torch.optim as optim # Define loss function and optimizer criterion = nn.MSELoss() optimizer = optim.Adam(model.parameters(), lr=0.001) # Convert training data to PyTorch tensors X_train_tensor = torch.tensor(X_train, dtype=torch.float32) y_train_tensor = torch.tensor(y_train, dtype=torch.float32) # Training loop epochs = 10 batch_size = 16 for epoch in range(epochs): model.train() for i in range(0, len(X_train_tensor), batch_size): X_batch = X_train_tensor[i:i+batch_size] y_batch = y_train_tensor[i:i+batch_size] # Forward pass outputs = model(X_batch) loss = criterion(outputs, y_batch) # Backward pass and optimization optimizer.zero_grad() loss.backward() optimizer.step() print(f'Epoch [{epoch+1}/{epochs}], Loss: {loss.item():.4f}') In this code, we define the criterion as nn.MSELoss() and the optimizer as optim.Adam(). We convert the training data to PyTorch tensors and implement a training loop that iterates over the data in batches. For each batch, we perform a forward pass, compute the loss, perform a backward pass, and update the model parameters.

Evaluating the Model and Summary

After training the model, it's important to evaluate its structure and performance. We can print the model structure directly to understand its configuration. Python # Print model structure print(model) # Print model structure print(model) Printing the model provides a detailed overview of the model, including the layers and their configurations. This information is valuable for understanding the complexity of the model and ensuring that it is correctly configured. In summary, you have learned how to build and train an RNN model for multivariate time series forecasting using PyTorch. We covered the model architecture, data splitting, compilation, and training process, providing you with the foundational skills needed to construct RNN models. As you move on to the practice exercises, I encourage you to apply these concepts and experiment with different parameters to deepen your understanding. Proper model building and training are key to achieving accurate time series forecasts.

Introduction to RNNs for Multivariate Time Series with PyTorch

Introduction to RNNs for Multivariate Time Series

Quick Recap of Preprocessing Steps

Join the 1M+ learners on CodeSignal

Splitting Data into Training and Test Sets

Setting Up the RNN Model

Building the RNN Model: Code Walkthrough

Compiling and Training the RNN Model

Evaluating the Model and Summary