Neural Networks from Scratch - P.7 Calculating Loss with Categorical Cross-Entropy

Channel:
United States sentdex
Subscribers:
1,420,000
Published on ● Video Link: https://www.youtube.com/watch?v=dEXPMQXoiLc


Duration: 16:19
106,986 views
2,897

In order to do backpropagation and optimization, we need to have some measure of how wrong the model is. For this, we use a loss function. In our case, with a softmax classifier, we'll be using categorical cross-entropy.

Next video: https://youtu.be/levekYbxauw

Neural Networks from Scratch book: https://nnfs.io

Playlist for this series: https://www.youtube.com/playlist?list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3

Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join
Discord: https://discord.gg/sentdex
Support the content: https://pythonprogramming.net/support-donate/
Twitter: https://twitter.com/sentdex
Instagram: https://instagram.com/sentdex
Facebook: https://www.facebook.com/pythonprogramming.net/
Twitch: https://www.twitch.tv/sentdex

#nnfs #python #neuralnetworks



Other Videos By sentdex


2021-05-07Generative Python Transformer p.2 - Raw Data Cleaning
2021-05-03Generative Python Transformer p.1 - Acquiring Raw Data
2021-04-30P.2 Chatbot with Mic input/Speaker output using Python, Jarvis, and DialoGPT
2021-04-26P.1 Chatbot with Mic input/Speaker output using Python, Jarvis, and DialoGPT
2021-04-232. Live coding Jarvis Transcriptions for Speech to Text Dataset p.2
2021-04-191. Live coding Jarvis Transcriptions for Speech to Text Dataset p.1
2021-04-16Conversational AI w/ Jarvis - checking out the API
2021-04-12Checking out one of the world’s first NVIDIA DGX Station A100s
2021-03-01Autoencoders in Python with Tensorflow/Keras
2021-01-30Cyber Python 2077 Part 2 - Getting to our objective
2021-01-23Neural Networks from Scratch - P.7 Calculating Loss with Categorical Cross-Entropy
2021-01-15Cyber Python 2077 - Using computer vision to read and walk from Cyberpunk 2077 map
2021-01-07The NEAT Algorithm is Neat
2020-12-18Neural Networks from Scratch - P.6 Softmax Activation
2020-10-14Jetson Nano 2GB from NVIDIA
2020-09-25NNFS Update #2: Content done
2020-07-24Sentdex Channel Update
2020-05-22AI-Based Game Engines with GameGAN research paper
2020-05-16NX Xavier Devkit + latest updates from NVIDIA!
2020-05-14Neural Networks from Scratch - P.5 Hidden Layer Activation Functions
2020-05-01Neural Networks from Scratch - P.4 Batches, Layers, and Objects