Compiling and Training Neural Networks with TensorFlow

Lesson Introduction

Hello again! By now, you should be familiar with building a Neural Network model's architecture in TensorFlow, so let's move on to finally compiling and training a neural network. In this lesson we'll use TensorFlow to compile our model with the Adam optimizer, Binary Crossentropy loss, and Accuracy metric. Then, we'll train the model using the fit() function. By the end of this lesson, you will understand how to compile and train a Neural Network model in TensorFlow.

Recap: Building the Neural Network Model

Before we dive into compiling and training, let's quickly recap how we can build a neural network model with TensorFlow. Our task will be to predict whether a student will pass or fail based on two input features: the number of hours studied and the number of hours slept. To accomplish this, we define a simple neural network model. Here's the code snippet to illustrate our model architecture: Python import tensorflow as tf # Define the model with 2 inputs (hours studied, hours slept) and 1 output (pass/fail) model = tf.keras.Sequential([tf.keras.layers.Input(shape=(2,)), tf.keras.layers.Dense(5, activation='relu'), tf.keras.layers.Dense(1, activation='sigmoid')]) import tensorflow as tf # Define the model with 2 inputs (hours studied, hours slept) and 1 output (pass/fail) model = tf.keras.Sequential([tf.keras.layers.Input(shape=(2,)), tf.keras.layers.Dense(5, activation='relu'), tf.keras.layers.Dense(1, activation='sigmoid')]) Input Layer: We specify an input shape of (2,) since we have two input features (hours studied and hours slept). Hidden Layer: The model has one hidden layer with 5 neurons and uses the ReLU activation function, which helps the model learn complex relationships in the data. Output Layer: The output layer has 1 neuron with a sigmoid activation function to predict the binary outcome (0 for fail or 1 for pass). With our model architecture finalized, we are now ready to move on to compiling and training the neural network.

Neural Network Model Compilation

After defining the neural network model's structure as seen in our previous lessons, the next step is to compile the model. The "compile" step in TensorFlow specifies the optimizer, loss function, and other parameters needed before we can train the model. This is how we compile our model: Python model.compile(optimizer='adam', loss='binary_crossentropy', metrics=['accuracy']) model.compile(optimizer='adam', loss='binary_crossentropy', metrics=['accuracy']) Now, let's delve into what each of these parameters means.

Optimizer

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

Training the Model

After compiling the model, the next step is training it on our data, which includes hours studied and hours slept as input features, and labels indicating whether a student passed or not. For this, we use the fit() function in TensorFlow. This function adjusts the model parameters to minimize the loss over several iterations (or epochs). Each epoch is one complete pass through the entire training dataset.

In real-life scenarios, datasets are often large and complex, requiring many training iterations for the model to learn its patterns, but for demonstration purposes, we are using a simple dataset and only 10 iterations:

Python

import numpy as np

# Example data: hours studied, hours slept
X = np.array([
    [4, 6], [5, 7], [2, 8], [1, 3], [3, 4], [0, 5],
    [1, 1], [2, 4], [3, 5], [5, 5], [0, 4], [4, 4],
])

# Labels: 1 if passed, 0 if failed
y = np.array([[1], [1], [1], [0], [0], [0], [0], [0], [1], [1], [0], [1]])

model.fit(X, y, epochs=10)

import numpy as np

# Example data: hours studied, hours slept
X = np.array([
    [4, 6], [5, 7], [2, 8], [1, 3], [3, 4], [0, 5],
    [1, 1], [2, 4], [3, 5], [5, 5], [0, 4], [4, 4],
])

# Labels: 1 if passed, 0 if failed
y = np.array([[1], [1], [1], [0], [0], [0], [0], [0], [1], [1], [0], [1]])

model.fit(X, y, epochs=10)

X is our input data (the hours studied and slept).
y is our labels (whether each student passed or not).
epochs=10 means we train over 10 complete passes through the training dataset.

TensorFlow will automatically convert these numpy arrays (X and y) into tensors internally during the training process.

The output of the above code will be:

text

Epoch 1/10
1/1 [=========================] - 2s 2s/step - accuracy: 0.5000 - loss: 2.5336
Epoch 2/10
1/1 [=========================] - 0s 39ms/step - accuracy: 0.5000 - loss: 2.5243
...
Epoch 10/10
1/1 [=========================] - 0s 40ms/step - accuracy: 0.5000 - loss: 2.4508

Epoch 1/10
1/1 [=========================] - 2s 2s/step - accuracy: 0.5000 - loss: 2.5336
Epoch 2/10
1/1 [=========================] - 0s 39ms/step - accuracy: 0.5000 - loss: 2.5243
...
Epoch 10/10
1/1 [=========================] - 0s 40ms/step - accuracy: 0.5000 - loss: 2.4508

This shows the model training process over 10 epochs, with each epoch showing the time taken per step, the accuracy, and the loss. The model starts with an accuracy of 0.5000 and a loss of 2.5336 and ends the 10th epoch with the same accuracy but a slightly reduced loss of 2.4508. It indicates that the model is learning and optimizing the loss function, albeit the accuracy remains constant in this particular run, suggesting further adjustments or more complex training data might be needed to improve the model's predictive accuracy.

Lesson Introduction

Recap: Building the Neural Network Model

Neural Network Model Compilation

Optimizer

Join the 1M+ learners on CodeSignal

Loss

Metrics

Training the Model

Lesson Summary and Practice