Convolutional Networks

The convolution, the layer built from it, and the architectures that made depth work.

Module 03.5 · Advanced
Free

11h · 14 lessons · 1 challenge

Before this: Structuring Machine Learning Projects

About this module

A fully connected layer on an image has more parameters than you have images. The convolution is the answer, and this module derives it from edge detection rather than presenting it as a definition: what a filter is, what padding and stride do, and how it extends over volumes.

Then the architectures, as a sequence of problems and solutions: LeNet, AlexNet and VGG, then ResNets and why depth suddenly became possible, then Inception and the efficient families.

After this module you can

14 lessons

Lesson 1
1Computer vision, and why fully connected fails
Kind
Concept
Length
40 min
Lesson 2
2Edge detection, and what a filter is
Kind
Concept
Length
45 min
Lesson 3
3Padding and strided convolutions
Kind
Concept
Length
45 min
Lesson 4
4Convolutions over volumes, and multiple filters
Kind
Concept
Length
45 min
Lesson 5
5One layer of a convolutional network
Kind
Concept
Length
50 min
Lesson 6
6Pooling layers, and a full CNN example
Kind
Concept
Length
45 min
Lesson 7
7Kernel Craft: build the filter that finds it
Kind
Interactive
Length
30 min
Lesson 8
8Classic networks: LeNet, AlexNet and VGG
Kind
Concept
Length
45 min
Lesson 9
9ResNets, and why depth became possible
Kind
Concept
Length
50 min
Lesson 10
101x1 convolutions and the Inception network
Kind
Concept
Length
45 min
Lesson 11
11MobileNet and efficient architectures
Kind
Concept
Length
40 min
Lesson 12
12Transfer learning and augmentation for vision
Kind
Concept
Length
45 min
Lesson 13
13Build and fine-tune an image classifier
Kind
Lab
Length
90 min
Lesson 14
14Checkpoint: shapes, receptive fields, choices
Kind
Checkpoint
Length
25 min

The challenge: Kernel Craft

A feature to detect and a three-by-three grid. Hand-build the filter that finds it, before you are allowed to train one.

Worth 450 XP.

Related modules

All modules
Word Embeddings
9h · 12 lessons
Attention & the Transformer
11h · 13 lessons