A law of robustness and the importance of overparametrization in deep learning

A law of robustness and the importance of overparametrization in deep learning

Channel:
Microsoft Research
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=ujMvnQpP528


Duration: 4:57
12,107 views
324

Microsoft Research Senior Principal Researcher Sebastien Bubeck answers several questions about the NeurIPS 2021 paper, “A Universal Law of Robustness via Isoperimetry.” He discusses what overparametrization is, the law of robustness, and how these two concepts can impact the future of large deep neural network research.

Read the paper in full here: https://www.microsoft.com/en-us/research/publication/a-universal-law-of-robustness-via-isoperimetry/



Other Videos By Microsoft Research


2022-01-04Plenary Talk: From mathematics to data science and back
2022-01-04Talk: Causal inference, observational studies, and the 2021 Nobel Prize in Economics
2022-01-04AI for Programming Education
2022-01-04Talk: Recent results on stochastic 3D Navier-Stokes equations
2022-01-04Talk: Theoretical Aspects of Gradient Methods in Deep Learning
2022-01-04Recap video of 2021 MSR Asia Theory Workshop (Long version)
2022-01-04SysSieve: Extracting Actionable Insights from Unstructured Text
2022-01-03Fourier Feature Networks and Neural Volume Rendering
2021-12-20DIABLo: a Deep Individual-Agnostic Binaural Localizer
2021-12-16Our Genomes, Our Selves?
2021-12-01A law of robustness and the importance of overparametrization in deep learning
2021-11-29Research for Industries (RFI) Lecture Series: Steven K. Frey
2021-11-24Research for Industries (RFI) Lecture Series: Matthew Realff & Christopher Jones
2021-11-23On Race and Technoculture
2021-11-08Acrylic, metal & a means of preparation: Imagining & living Black life beyond the surveillance state
2021-11-01FastNeRF: High-Fidelity Neural Rendering at 200FPS [Extended]
2021-10-29Full-Body Motion from a Single Head-Mounted Device: Generating SMPL Poses from Partial Observations
2021-10-29Litmus Predictor
2021-10-25Interview and Q&A with Jenny Sabin, Creator of the Ada Installation in Microsoft Building 99
2021-10-20Microsoft Research 2021 Global PhD Fellowship Recipients
2021-10-19Precision agriculture uses computer science to make farms more efficient and reduce climate change