On the Foundations of Deep Learning: SGD, Overparametrization, and Generalization

Channel:
United States Simons Institute for the Theory of Computing
Subscribers:
68,700
Published on ● Video Link: https://www.youtube.com/watch?v=l0im8AJAMco


Duration: 45:39
4,491 views
106

Jason Lee (University of Southern California)
https://simons.berkeley.edu/talks/tbd-50
Frontiers of Deep Learning



Other Videos By Simons Institute for the Theory of Computing


2019-07-17Interpreting Deep Neural Networks (DNNs)
2019-07-171Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
2019-07-17A New Perspective on Adversarial Perturbations
2019-07-17Provable Robustness Beyond Bound Propagation
2019-07-16Splitting Gradient Descent for Incremental Learning of Neural Architectures
2019-07-16Mad Max: Affine Spline Insights into Deep Learning
2019-07-16Computation in Very Wide Neural Networks
2019-07-16Training on the Test Set and Other Heresies
2019-07-16Explaining Landscape Connectivity of Low-cost Solutions for Multilayer Nets
2019-07-16A Primal-dual Analysis of Margin Maximization by Steepest Descent Methods
2019-07-16On the Foundations of Deep Learning: SGD, Overparametrization, and Generalization
2019-07-15Size-free Generalization Bounds for Convolutional Neural Networks
2019-07-15Learning and Generalization in Over-parametrized Neural Networks, Going Beyond Kernels
2019-07-15From Classical Statistics to Modern Machine Learning
2019-07-15Analyzing Optimization and Generalization in Deep Learning via Trajectories of Gradient Descent
2019-07-15Practical Model-based Algorithms for Reinforcement Learning and Imitation Learning, with...
2019-07-15Benign Overfitting in Linear Prediction
2019-07-12Expansion from a Cohomological Viewpoint
2019-07-12Spectral HDX III: Random Walks
2019-07-12Connection Between Codes and HDX Part 2
2019-07-12Connection Between Codes and HDX Part 1


Tags:
Frontiers of Deep Learning
Jason Lee
Simons Institute
Theory of Computing
Theory of Computation
Theoretical Computer Science
Computer Science
UC Berkeley