Artificial Intelligence

4,064 learners

Gradient Descent: Building Optimization Algorithms from Scratch

Delve into the intricacies of optimization techniques with this immersive course that focuses on the implementation of various algorithms from scratch. Bypass high-level libraries to explore Stochastic Gradient Descent, Mini-Batch Gradient Descent, and advanced optimization methods such as Momentum, RMSProp, and Adam.

Python

See path

5 lessons

21 practices

4 hours

Coding and Data Algorithms

Course details

Stochastic Gradient Descent: Theory and Implementation in Python

Preview

Observing Stochastic Gradient Descent in Action

Tuning the Learning Rate in SGD

Stochastic Sidesteps: Updating Model Parameters

Updating the Linear Regression Model Params with SGD

Previous Course Next Course: Ensemble Methods from Scratch

Turn screen time into skills time

Practice anytime, anywhere with our mobile app.

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

From our community

Hear what our customers have to say about CodeSignal Learn

I'm impressed by the quality and can't stop recommending it. It's also a lot of fun!

Francisco Aguilar Meléndez

Data Scientist

+11

I love that it's personalized. When I'm stuck, I don't have to hope my Google searches come out successful. The AI mentor Cosmo knows exactly what I need.

Faith Yim

Software Engineer

+14

It's an amazing product and exceeded my expectations, helping me prepare for my job interviews. Hands-on learning requires you to actually know what you are doing.

Alex Bush

Full Stack Engineer

I'm really impressed by the AI tutor Cosmo's feedback about my code. It's honestly kind of insane to me that it's so targeted and specific.

Abbey Helterbran

Tech consultant

I tried Leetcode but it was too disorganized. CodeSignal covers all the topics I'm interested in and is way more structured.

Jonathan Miller

Senior Machine Learning Engineer

+12

I'm impressed by the quality and can't stop recommending it. It's also a lot of fun!

Francisco Aguilar Meléndez

Data Scientist

+11

From our community

Hear what our customers have to say about CodeSignal Learn

I'm impressed by the quality and can't stop recommending it. It's also a lot of fun!

Francisco Aguilar Meléndez

Data Scientist

+11

I love that it's personalized. When I'm stuck, I don't have to hope my Google searches come out successful. The AI mentor Cosmo knows exactly what I need.

Faith Yim

Software Engineer

+14

It's an amazing product and exceeded my expectations, helping me prepare for my job interviews. Hands-on learning requires you to actually know what you are doing.

Alex Bush

Full Stack Engineer

I'm really impressed by the AI tutor Cosmo's feedback about my code. It's honestly kind of insane to me that it's so targeted and specific.

Abbey Helterbran

Tech consultant

I tried Leetcode but it was too disorganized. CodeSignal covers all the topics I'm interested in and is way more structured.

Jonathan Miller

Senior Machine Learning Engineer

+12

I'm impressed by the quality and can't stop recommending it. It's also a lot of fun!

Francisco Aguilar Meléndez

Data Scientist

+11

Gradient Descent: Building Optimization Algorithms from Scratch

Course details

Unit 14 practices48 min

Unit 24 practices48 min

Unit 34 practices48 min

Unit 45 practices57 min

Unit 54 practices48 min

Turn screen time into skills time

Join the 1M+ learners on CodeSignal

From our community

From our community