What is Optimization? + Learning Gradient Descent | Two Minute Papers #82

Channel:
Hungary Two Minute Papers
Subscribers:
1,720,000
Published on ● Video Link: https://www.youtube.com/watch?v=1ypV5ZiIbdA


Duration: 5:31
13,591 views
297

Let's talk about what mathematical optimization is, how gradient descent can solve simpler optimization problems, and Google DeepMind's proposed algorithm that automatically learn optimization algorithms.

The paper "Learning to learn by gradient descent
by gradient descent" is available here:
http://arxiv.org/pdf/1606.04474v1.pdf

Source code:
https://github.com/deepmind/learning-to-learn

______________________________

Recommended for you:
Gradients, Poisson's Equation and Light Transport - https://www.youtube.com/watch?v=sSnDTPjfBYU

WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE:
David Jaenisch, Sunil Kim, Julian Josephs, Daniel John Benton.
https://www.patreon.com/TwoMinutePapers

We also thank Experiment for sponsoring our series. - https://experiment.com/

Subscribe if you would like to see more of these! - http://www.youtube.com/subscription_center?add_user=keeroyz

The chihuahua vs muffin image is a courtesy of teenybiscuit - https://twitter.com/teenybiscuit
More fun stuff here: http://twistedsifter.com/2016/03/puppy-or-bagel-meme-gallery/


The thumbnail background image was created by Alan Levine - https://flic.kr/p/vbEd1W
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu

Károly Zsolnai-Fehér's links:
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/



Other Videos By Two Minute Papers


2016-09-06Automatic Hair Modeling from One Image | Two Minute Papers #92
2016-09-01StyLit, Illumination-Guided Artistic Style Transfer | Two Minute Papers #91
2016-08-29Interactive Hair-Solid Simulations | Two Minute Papers #90
2016-08-253D Printing With Filigree Patterns | Two Minute Papers #89
2016-08-17Neural Material Synthesis | Two Minute Papers #88
2016-08-14On the Complexity of Two Minute Papers | Two Minute Papers #87
2016-08-11What is an Autoencoder? | Two Minute Papers #86
2016-08-08The Science of Medal Predictions (2016 Rio Olympics Edition) | Two Minute Papers #85
2016-08-03Peer Review and the NeurIPS Experiment | Two Minute Papers #84
2016-07-31Task-based Animation of Virtual Characters | Two Minute Papers #83
2016-07-29What is Optimization? + Learning Gradient Descent | Two Minute Papers #82
2016-07-25Bundlefusion: 3D Scenes from 2D Videos | Two Minute Papers #81
2016-07-20Photorealistic Images from Drawings | Two Minute Papers #80
2016-07-17Visually Indicated Sounds | Two Minute Papers #79
2016-07-13Time Varying Textures | Two Minute Papers #78
2016-07-05Fermat Spirals for Layered 3D Printing | Two Minute Papers #77
2016-06-26Procedural Yarn Models for Cloth Rendering | Two Minute Papers #76
2016-06-22What Can We Learn From Deep Learning Programs? | Two Minute Papers #75
2016-06-19Hallucinating Images With Deep Learning | Two Minute Papers #74
2016-06-15Rocking Out With Convolutions | Two Minute Papers #73
2016-06-12Reinforcement Learning with OpenAI's Gym | Two Minute Papers #72


Tags:
two minute papers
deepmind
deepmind gradient descent
google deepmind gradient descent
deepmind learning
learning gradient descent
deepmind learning gradient descent
Learning to learn by gradient descent by gradient descent
deepmind learning to learn
optimization
mathematical optimization
gradient descent
nonlinear optimization
linear optimization
convex optimization
non-convex optimization
nonconvex optimization
what is optimization
what is gradient descent