Unsupervised Learning & Anomaly Detection

Clustering without labels, and finding the rare event you have almost no examples of.

Module 02.7 · Intermediate
Free

8h · 11 lessons · 1 challenge

Before this: Decision Trees & Ensembles

About this module

Clustering is the first thing to reach for when nothing is labelled. K-means is derived here from its objective rather than described as a procedure, which is what makes initialization and the choice of k make sense.

Anomaly detection follows, and uses the multivariate Gaussian from the probability module. The last lesson is the one that matters in practice: when to model anomalies and when to just train a classifier.

After this module you can

11 lessons

Lesson 1
1What clustering is
Kind
Concept
Length
40 min
Lesson 2
2K-means: intuition and algorithm
Kind
Concept
Length
45 min
Lesson 3
3The k-means objective, initialization and choosing k
Kind
Concept
Length
50 min
Lesson 4
4Hierarchical and density-based clustering
Kind
Concept
Length
45 min
Lesson 5
5Finding unusual events: the anomaly detection algorithm
Kind
Concept
Length
50 min
Lesson 6
6The Gaussian model, and choosing what features to use
Kind
Concept
Length
45 min
Lesson 7
7Developing and evaluating an anomaly detection system
Kind
Concept
Length
45 min
Lesson 8
8Anomaly detection versus supervised learning
Kind
Concept
Length
40 min
Lesson 9
9Embedding Illusions: read the projection
Kind
Interactive
Length
30 min
Lesson 10
10Anomaly detection on production telemetry
Kind
Lab
Length
80 min
Lesson 11
11Checkpoint: evaluate without labels
Kind
Checkpoint
Length
25 min

The challenge: Embedding Illusions

Six two-dimensional projections of the same data. Say which structure is real and which the projection invented.

Worth 350 XP.

Related modules

All modules
Recommender Systems
7h · 9 lessons
Reinforcement Learning
8h · 10 lessons
Neural Networks & Deep Learning
10h · 12 lessons
Making Deep Networks Train
9h · 12 lessons