Neural Networks: the First Pass

Neurons, layers, forward propagation and a training loop, before the deep learning track takes it apart.

Module 02.4 · Intermediate
Free

7h · 9 lessons · 1 challenge

Before this: Overfitting, Regularization & Model Selection

About this module

A neural network is a stack of the logistic units you already built. This module assembles them: neurons and layers, forward propagation by hand and vectorized, then the training loop that fits them.

It is deliberately the first pass. The Deep Learning track rebuilds all of this from scratch and takes the backward pass apart properly; this is the on-ramp that makes that possible.

After this module you can

9 lessons

Lesson 1
1Neurons, layers and the network diagram
Kind
Concept
Length
45 min
Lesson 2
2Forward propagation, one layer at a time
Kind
Concept
Length
45 min
Lesson 3
3Vectorized forward propagation across a batch
Kind
Concept
Length
45 min
Lesson 4
4Training a network: loss and the training loop
Kind
Concept
Length
50 min
Lesson 5
5Activation functions, and choosing between them
Kind
Concept
Length
45 min
Lesson 6
6Multiclass, softmax and the output layer
Kind
Concept
Length
45 min
Lesson 7
7Layer Lab: assemble a net that hits the target
Kind
Interactive
Length
30 min
Lesson 8
8Build and train a small network
Kind
Lab
Length
80 min
Lesson 9
9Checkpoint: trace the forward pass
Kind
Checkpoint
Length
25 min

The challenge: Layer Lab

A target function and a budget of neurons. Assemble the smallest network that fits it.

Worth 350 XP.

Related modules

All modules
Applying Machine Learning
9h · 12 lessons
Decision Trees & Ensembles
8h · 11 lessons
Recommender Systems
7h · 9 lessons