10.16: Neural Networks: Backpropagation Part 3 - The Nature of Code

Channel:
United States The Coding Train
Subscribers:
1,740,000
Published on ● Video Link: https://www.youtube.com/watch?v=8H2ODPNxEgA


Duration: 20:21
80,791 views
1,434

In this video, I discuss how "gradient descent" can be used to adjust the weights during back propagation in my "toy" JavaScript neural network library.

Next video: https://youtu.be/qB2nwJxNVxM

This video is part of Chapter 10 of The Nature of Code (http://natureofcode.com/book/chapter-10-neural-networks/)

This video is also part of session 4 of my Spring 2017 ITP "Intelligence and Learning" course (https://github.com/shiffman/NOC-S17-2-Intelligence-Learning/tree/master/week4-neural-networks)

Support this channel on Patreon: https://patreon.com/codingtrain
To buy Coding Train merchandise: https://www.designbyhumans.com/shop/codingtrain/
To donate to the Processing Foundation: https://processingfoundation.org/

Send me your questions and coding challenges!: https://github.com/CodingTrain/Rainbow-Topics

Contact:
Twitter: https://twitter.com/shiffman
The Coding Train website: http://thecodingtrain.com/

Links discussed in this video:
The Coding Train on Amazon: https://www.amazon.com/shop/thecodingtrain
Deeplearn.js: https://deeplearnjs.org/
Backpropagation on Wikipedia: https://en.wikipedia.org/wiki/Backpropagation
Machine Learning for Artists: https://github.com/ml4a
Matrix Math website: http://matrixmultiplication.xyz/

Videos mentioned in this video:
My Neural Networks series: https://www.youtube.com/playlist?list=PLRqwX-V7Uu6aCibgK1PTWWu9by6XFdCfh
3Blue1Brown Neural Networks playlist: https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi
3Blue1Brown's Linear Algebra playlist: https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab
My Video on Gradient Descent: https://youtu.be/jc2IthslyzM
My Video on Perceptron: https://youtu.be/ntKn5TPHHAk
My Video on Linear Regression: https://youtu.be/L-Lsfu4ab74

Source Code for the all Video Lessons: https://github.com/CodingTrain/Rainbow-Code

p5.js: https://p5js.org/
Processing: https://processing.org

The Nature of Code playlist: https://www.youtube.com/user/shiffman/playlists?view_as=subscriber&shelf_id=6&view=50&sort=dd
For More Coding Challenges: https://www.youtube.com/playlist?list=PLRqwX-V7Uu6ZiZxtDDRCi6uhfTH4FilpH
For More Intelligence and Learning: https://www.youtube.com/playlist?list=PLRqwX-V7Uu6YJ3XfHhT2Mm4Y5I99nrIKX

📄 Code of Conduct: https://github.com/CodingTrain/Code-of-Conduct



Other Videos By The Coding Train


2018-02-14CircleCI Part 4: Matrix Library Testing and Continuous Integration
2018-02-13Coding Challenge #93: Double Pendulum
2018-02-12Coding Challenge #92: XOR Problem
2018-02-10Live Stream #120: MNIST and Pendulums
2018-02-10CircleCI Part 3: Continuous Integration with GitHub
2018-02-09CircleCI Part 2: Unit Testing with Jest
2018-02-08CircleCI Part 1: Introduction to Unit Testing and Continuous Integration
2018-02-07Live Stream #119 - Solving Merge Conflicts and XOR Problem
2018-02-0710.18: Neural Networks: Backpropagation Part 5 - The Nature of Code
2018-02-0610.17: Neural Networks: Backpropagation Part 4 - The Nature of Code
2018-02-0510.16: Neural Networks: Backpropagation Part 3 - The Nature of Code
2018-02-04Live Stream #118 - More Neural Networks
2018-02-03Live Stream #117.2 - Unit Testing and CI with CircleCI - Part 2
2018-02-03Coding Train Live 117.1 - Unit Testing and CI with CircleCI - Part 1
2018-01-31Coding Challenge #91: Snakes & Ladders - Part 3
2018-01-30Coding Challenge #91: Snakes & Ladders - Part 2
2018-01-29Coding Challenge #91: Snakes & Ladders - Part 1
2018-01-28Live Stream #116.2 - Snakes & Ladders Continued + 2048
2018-01-27Live Stream #116.1 - Snakes & Ladders
2018-01-2410.15: Neural Networks: Backpropagation Part 2 - The Nature of Code
2018-01-2310.14: Neural Networks: Backpropagation Part 1 - The Nature of Code


Tags:
JavaScript (Programming Language)
live
programming
daniel shiffman
creative coding
coding challenge
tutorial
coding
challenges
coding train
the coding train
nature of code
artificial intelligence
live stream
itp nyu
neural network
neural network artist
machine learning
machine learning art
perceptron
linear algebra
neural network intro
neural net
matrix math
matrix multiplication
gradient descent
back propagation
backpropagation
supervised learning