Classification & Logistic Regression

Decision boundaries, the logistic link, and a cost function that comes from the likelihood.

Module 02.2 · Beginner
Free

7h · 9 lessons · 1 challenge

Before this: Supervised Learning & Linear Regression

About this module

Linear regression fails at classification, and the way it fails is instructive. This module replaces it: the logistic function, the decision boundary it draws, and the cost function that makes it trainable.

That cost is cross-entropy, which the probability module already derived from maximum likelihood. Here it arrives as the thing gradient descent actually minimizes.

After this module you can

9 lessons

Lesson 1
1Why linear regression fails at classification
Kind
Concept
Length
40 min
Lesson 2
2The logistic function and the decision boundary
Kind
Concept
Length
45 min
Lesson 3
3The cost function for logistic regression
Kind
Concept
Length
50 min
Lesson 4
4Gradient descent for logistic regression
Kind
Concept
Length
45 min
Lesson 5
5The confusion matrix: precision, recall and F1
Kind
Concept
Length
45 min
Lesson 6
6ROC, PR curves and which to trust when
Kind
Concept
Length
45 min
Lesson 7
7Threshold Tuner: set the cutoff under real costs
Kind
Interactive
Length
30 min
Lesson 8
8Class imbalance: resampling, weighting, and what fails
Kind
Lab
Length
80 min
Lesson 9
9Checkpoint: pick the metric, justify it
Kind
Checkpoint
Length
25 min

The challenge: Threshold Tuner

A classifier and a cost matrix. Move the threshold to the point that costs the business least, then defend it.

Worth 350 XP.

Related modules

All modules