Building an LSTM for Time Series Forecasting

Introduction to Building LSTMs for Time Series Forecasting

Welcome to the next step in your journey through the " Time Series Forecasting with LSTMs " course. In this lesson, we will focus on building and training an LSTM model specifically for time series forecasting using temperature data. As you may recall from the previous lesson, LSTMs are particularly adept at capturing temporal dependencies in sequence data, making them ideal for this task. Our goal is to guide you through the process of constructing an LSTM model that can effectively forecast future values based on historical data.

Understanding the LSTM Model Architecture

Before we dive into the code, let's take a moment to understand the architecture of the LSTM model we will be building. The model consists of several key components: Input Layer : This layer defines the shape of the input data. In our example, the input shape is determined by the sequence length and the number of features. For temperature data, we will use a sequence length of 10 and 2 features. LSTM Layers : Our model includes two LSTM layers, each with 16 units. The choice of 16 units is a balance between model complexity and computational efficiency. Fewer units can reduce the risk of overfitting and require less computational resources, while still capturing essential patterns in the data. These layers are responsible for capturing the temporal dependencies in the data. We use the relu activation function to help the model learn complex patterns. Dense Output Layer : The final layer is a Dense layer with a single unit. This layer produces the forecasted value based on the learned patterns from the LSTM layers. Understanding these components will help you grasp how the model processes the input data to generate forecasts.

Preparing the Data: Chronological Train-Test Split

For time series forecasting, it is crucial to maintain the temporal order of the data when splitting into training and testing sets. Instead of using train_test_split, which randomly shuffles the data, we should split the data chronologically. Here’s how you can do it: Python # Assume X and y are your input sequences and target values split_index = int(len(X) * 0.8) # 80% for training, 20% for testing X_train, X_test = X[:split_index], X[split_index:] y_train, y_test = y[:split_index], y[split_index:] This approach ensures that the model is trained on past data and evaluated on future data, preserving the integrity of the time series and preventing data leakage.

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

Evaluating the Model with RMSE

After obtaining the predictions, it's important to evaluate the model's performance. One common metric for time series forecasting is the Root Mean Square Error (RMSE), which provides a measure of the differences between predicted and actual values. To accurately calculate RMSE, you need to rescale the predictions and actual values back to their original scale if they were normalized or standardized before training. Here's how you can calculate RMSE and compare it with the feature range:

Python

from sklearn.metrics import mean_squared_error
import numpy as np

# Rescale predictions and actual values
predictions_rescaled = scaler.inverse_transform(predictions)
y_test_rescaled = scaler.inverse_transform(y_test)

# Calculate RMSE
rmse = np.sqrt(mean_squared_error(y_test_rescaled, predictions_rescaled))
print(f'RMSE: {rmse}')

# Calculate feature range
feature_min = original_data.min().values[0]
feature_max = original_data.max().values[0]
feature_range = feature_max - feature_min
print(f'Feature Range: {feature_min} to {feature_max}')
print(f'Feature Range: {feature_range}')

# Compare RMSE with feature range
if rmse < feature_range * 0.1:
    print("The RMSE is less than 10% of the feature range, indicating good model performance.")
else:
    print("The RMSE is greater than 10% of the feature range, suggesting room for improvement.")

from sklearn.metrics import mean_squared_error
import numpy as np

# Rescale predictions and actual values
predictions_rescaled = scaler.inverse_transform(predictions)
y_test_rescaled = scaler.inverse_transform(y_test)

# Calculate RMSE
rmse = np.sqrt(mean_squared_error(y_test_rescaled, predictions_rescaled))
print(f'RMSE: {rmse}')

# Calculate feature range
feature_min = original_data.min().values[0]
feature_max = original_data.max().values[0]
feature_range = feature_max - feature_min
print(f'Feature Range: {feature_min} to {feature_max}')
print(f'Feature Range: {feature_range}')

# Compare RMSE with feature range
if rmse < feature_range * 0.1:
    print("The RMSE is less than 10% of the feature range, indicating good model performance.")
else:
    print("The RMSE is greater than 10% of the feature range, suggesting room for improvement.")

In this code, we first rescale the predictions and actual values using the inverse transformation of the scaler used during preprocessing. We then use the mean_squared_error function from sklearn.metrics to calculate the mean squared error between the rescaled actual values y_test_rescaled and the model's rescaled predictions predictions_rescaled. We take the square root of this value to obtain the RMSE. To assess the RMSE, we calculate the range of the feature values and compare the RMSE to a percentage of this range. If the RMSE is less than 10% of the feature range, it indicates good model performance. Otherwise, there may be room for improvement.

Introduction to Building LSTMs for Time Series Forecasting

Understanding the LSTM Model Architecture

Preparing the Data: Chronological Train-Test Split

Join the 1M+ learners on CodeSignal

Building the LSTM Model: Step-by-Step Example

Training the LSTM Model

Making Predictions with the LSTM Model

Evaluating the Model with RMSE

Summary and Preparation for Practice Exercises