Why Deep Learning Works: Implicit Self-Regularization in Deep Neural Networks

Published on ● Video Link: https://www.youtube.com/watch?v=bd19nrIYlTc



Duration: 38:13
3,209 views
54


Michael Mahoney (International Computer Science Institute and UC Berkeley)
https://simons.berkeley.edu/talks/9-24-mahoney-deep-learning
Randomized Numerical Linear Algebra and Applications




Other Videos By Simons Institute for the Theory of Computing


2018-09-26Randomized Constrained Matrix Decompositions
2018-09-26Hessian Matrix Inversion in 10^10 Dimensions with Parametric Bootstraps
2018-09-26Ridge Regression and Deterministic Ridge Leverage Score Sampling
2018-09-25Scalable Algorithmic Primitives for Data Science
2018-09-25Error Estimation for Randomized Numerical Linear Algebra: Bootstrap Methods
2018-09-25Applying Randomized Methods for Zonotope Enumeration and...
2018-09-25Randomized Algorithms for Computing Full Matrix Factorizations
2018-09-25Convergence Theory for Iterative Eigensolvers
2018-09-25Randomized Riemannian Preconditioning for Quadratically Constrained Problems
2018-09-25Stochastic Quasi-Gradient Methods: Variance Reduction via Jacobian Sketching
2018-09-24Why Deep Learning Works: Implicit Self-Regularization in Deep Neural Networks
2018-09-24How Randomized Analysis Can Help Us Do “Data Science:” Examples in Deep Learning and Graph Analysis
2018-09-24Reconstructing Continuous Signals via Leverage Score Sampling
2018-09-24Asympirical Analysis: Theory Informs Practice
2018-09-24Recent Advances in Positive Semidefinite Matrix Approximation
2018-09-24Advanced Techniques for Low-Rank Matrix Approximation
2018-09-24Randomized Numerical Linear Algebra: Overview
2018-09-24Randomized Least Squares Regression: Combining Model- and Algorithm-Induced Uncertainties
2018-09-14A Short List of Equalities Has Large Sign Rank
2018-09-14The Coin Problem and AC^0[parity]
2018-09-14Does Looking Inside a Circuit Help?



Tags:
Randomized Numerical Linear Algebra and Applications
Michael Mahoney
Simons Institute
Theory of Computing
Theory of Computation
Theoretical Computer Science
Computer Science
UC Berkeley