09 Neural networks

Course:

• Neural networks, from perceptrons to deep learning - David Gianazza (slides 33-75)
• Neural networks - Backpropagation & chain rule - animated - Quentin Chenevier
• Interactive Gradient Descent Demo
• Batch, Mini-Batch and Stochastic Gradient Descent for Linear Regression
• Tensorflow playground demos - Quentin Chenevier
• Regularization techniques for training deep neural networks

Other useful resources:

• The Matrix Calculus You Need For Deep Learning
• Why Momentum Really Works
• Deep Learning course: lecture slides and lab notebooks - Master Year 2 Data Science IP-Paris