Dot Product and Matrix Multiplication

Dot Product and Matrix Multiplication | CodeSignal Learn

Lesson Introduction

Welcome to our lesson on "Dot Product and Matrix Multiplication"! These topics are key in machine learning as they help computers process data efficiently. By the end of this lesson, you'll know what dot products and matrix multiplication are, how to calculate them, and how to implement these operations in Python. These concepts are used in tasks like recognizing faces in photos, predicting the weather, and much more. Let's dive in and see how they work!

Dot Product

v_1 \cdot v_2 = \sum_{i=1}^{n} v_{1i} \cdot v_{2i}

Real-Life Example of Dot Product

\text{Total Cost} = \text{quantity} \cdot \text{price} = \sum_{i=1}^{n} \text{quantity}_{i} \cdot \text{price}_{i}

Python Code for Dot Product

Here's how to calculate the dot product in Python using NumPy: Python import numpy as np # Vectors v1 = np.array([1, 2, 3]) v2 = np.array([4, 5, 6]) # Calculate and print the dot product print("Dot Product:", np.dot(v1, v2)) # Dot Product: 32 This code uses NumPy's dot function, which directly calculates the dot product of vectors v1 and v2 . You've successfully calculated the dot product!

Matrix Multiplication

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

First, let's talk about the dot product. It's a way to combine two vectors into a single number. Think of playing a game where you multiply pairs of numbers and add the results. With numbers [1, 2, 3] and [4, 5, 6]:

Multiply 1 by 4 to get 4.
Multiply 2 by 5 to get 10.
Multiply 3 by 6 to get 18.

Add them: 4 + 10 + 18 = 32. That's the dot product! Mathematically:

$v_1 \cdot v_2 = \sum_{i=1}^{n} v_{1i} \cdot v_{2i}$

Consider the scenario of calculating the total price of groceries.

Quantities of items: [2, 3, 1] (for instance, 2 apples, 3 bananas, and 1 cherry)
Prices per item: [1.5, 0.5, 3.0]

To find the total cost, multiply the quantities by the respective prices.

Multiply 2 (apples) by 1.5 ($ per apple) to get 3.0.
Multiply 3 (bananas) by 0.5 ($ per banana) to get 1.5.
Multiply 1 (cherry) by 3.0 ($ per cherry) to get 3.0.

Add them: 3.0 + 1.5 + 3.0 = 7.5. So, the total cost of groceries is $7.5.

Mathematically, this can be expressed as the dot product of the quantity and price vectors:

$\text{Total Cost} = \text{quantity} \cdot \text{price} = \sum_{i=1}^{n} \text{quantity}_{i} \cdot \text{price}_{i}$

Python Code for Matrix Multiplication

Here's how to do it in Python using NumPy: Pythonimport numpy as np # Matrices m1 = np.array([[1, 2], [3, 4]]) m2 = np.array([[5, 6], [7, 8]]) # Calculate and print result print("Matrix Multiplication:\n", np.dot(m1, m2)) # Matrix Multiplication: # [[19 22] # [43 50]]import numpy as np # Matrices m1 = np.array([[1, 2], [3, 4]]) m2 = np.array([[5, 6], [7, 8]]) # Calculate and print result print("Matrix Multiplication:\n", np.dot(m1, m2)) # Matrix Multiplication: # [[19 22] # [43 50]] This code uses NumPy's dot function to perform matrix multiplication on matrices m1 and m2, resulting in matrix C.

Next, let's talk about matrix multiplication. This helps combine two matrices into a new matrix. Imagine matrices as grids of numbers. Multiplying matrices combines rows and columns in a specific way. Given two matrices A and B:

\textbf{A} = \begin{bmatrix} a_{11} & a_{12} \\ a_{21} & a_{22} \end{bmatrix}

\textbf{B} = \begin{bmatrix} b_{11} & b_{12} \\ b_{21} & b_{22} \end{bmatrix}

To find element c_{ij} in the resulting matrix C, take the dot product of the i-th row of A and the j-th column of B:

\textbf{C} = \begin{bmatrix} c_{11} & c_{12} \\ c_{21} & c_{22} \end{bmatrix}

For example, $c_{11}$ here is a dot product of the first row of $\textbf{A}$ and the first column of $\textbf{B}$ . The $c_{12}$ is a dot product of the first row of $\textbf{A}$ and the second column of $\textbf{B}$ , and so on.

More specifically:

$c_{11} = a_{11} \cdot b_{11} + a_{12} \cdot b_{21}$

$c_{12} = a_{11} \cdot b_{12} + a_{12} \cdot b_{22}$

$c_{21} = a_{21} \cdot b_{11} + a_{22} \cdot b_{21}$

$c_{22} = a_{21} \cdot b_{12} + a_{22} \cdot b_{22}$

The resulting matrix C will have as many rows as A and as many columns as B. Think of it as "we multiply n rows by m columns, so the resulting matrix is of $n \times m$ shape.

Matrix multiplication is only possible when the number of columns in matrix A is equal to the number of rows in matrix B.

Let's look at some examples:

Matrix A (2x3):

\textbf{A} = \begin{bmatrix} 1 & 2 & 3 \\ 4 & 5 & 6 \end{bmatrix}

Matrix B (3x2):

\textbf{B} = \begin{bmatrix} 7 & 8 \\ 9 & 10 \\ 11 & 12 \end{bmatrix}

Matrix multiplication is possible here because the number of columns in A (3) is equal to the number of rows in B (3). The resulting matrix, C, will have dimensions 2x2, as we multiply 2 rows by 2 columns.

Matrix A (2x3):

\textbf{A} = \begin{bmatrix} 1 & 2 & 3 \\ 4 & 5 & 6 \end{bmatrix}

Matrix B (2x2):

\textbf{B} = \begin{bmatrix} 7 & 8 \\ 9 & 10 \end{bmatrix}

Matrix multiplication is not possible here because the number of columns in A (3) does not equal the number of rows in B (2).

Matrix A (2x3):

\textbf{A} = \begin{bmatrix} 1 & 2 & 3 \\ 4 & 5 & 6 \end{bmatrix}

Vector v (3x1):

\textbf{v} = \begin{bmatrix} 7 \\ 8 \\ 9 \end{bmatrix}

Matrix multiplication is possible here because the number of columns in A (3) is equal to the number of rows in vector v (3). The resulting vector will have the dimensions 2x1, as we multiply 2 rows by 1 column.

Consider a scenario where you're tracking the sales of two salespersons across three different products over two months. You have the sales data and the price per product:

Sales Matrix (A):

\textbf{A} = \begin{bmatrix} 10 & 15 & 8 \\ 12 & 18 & 5 \end{bmatrix}

Price Matrix (B):

\textbf{B} = \begin{bmatrix} 20 \\ 30 \\ 50 \end{bmatrix}

To find the total revenue generated by each salesperson, you'll perform matrix multiplication:

$c_{11} = (10 \cdot 20) + (15 \cdot 30) + (8 \cdot 50) = 200 + 450 + 400 = 1050$

$c_{21} = (12 \cdot 20) + (18 \cdot 30) + (5 \cdot 50) = 240 + 540 + 250 = 1030$

So, the resulting revenue matrix C is:

\textbf{C} = \begin{bmatrix} 1050 \\ 1030 \end{bmatrix}

Lesson Introduction

Dot Product

Real-Life Example of Dot Product

Python Code for Dot Product

Matrix Multiplication

Join the 1M+ learners on CodeSignal

When Matrices Can Be Multiplied: Example 1

When Matrices Can Be Multiplied: Example 2

When Matrices Can Be Multiplied: Example 3

Practical Example

Python Code for Matrix Multiplication

Lesson Summary