Supervised Learning & Linear Regression

The supervised setup, the cost function, and gradient descent doing the work.

Module 02.1 · Beginner
Free

8h · 11 lessons · 1 challenge

Before this: Array Programming & Vectorization, Calculus & Optimization

About this module

The first model, taken slowly. What supervised learning is, what a cost function measures, and what gradient descent does to it, one step at a time.

Then the parts that make it usable on real data: several features at once in vectorized form, feature scaling and why it changes how the run behaves, and the engineered and polynomial features that let a straight-line model fit a curve.

After this module you can

11 lessons

Lesson 1
1What machine learning is: supervised and unsupervised
Kind
Concept
Length
40 min
Lesson 2
2The linear regression model
Kind
Concept
Length
45 min
Lesson 3
3The cost function, and what it measures
Kind
Concept
Length
45 min
Lesson 4
4Gradient descent, and running it on a cost surface
Kind
Concept
Length
50 min
Lesson 5
5Gradient descent for linear regression
Kind
Concept
Length
45 min
Lesson 6
6Multiple features and the vectorized form
Kind
Concept
Length
45 min
Lesson 7
7Feature scaling, and checking for convergence
Kind
Concept
Length
45 min
Lesson 8
8Feature engineering and polynomial regression
Kind
Concept
Length
45 min
Lesson 9
9Fit Forensics: read the residual plot
Kind
Interactive
Length
30 min
Lesson 10
10Gradient descent on a real dataset
Kind
Lab
Length
80 min
Lesson 11
11Checkpoint: diagnose the regression
Kind
Checkpoint
Length
25 min

The challenge: Fit Forensics

Ten residual plots. Name what is wrong with each model from the residuals alone, before you are shown the data.

Worth 350 XP.

Related modules

All modules