Lookahead Optimizer: k steps forward, 1 step back

Channel:
Canada LLMs Explained - Aggregate Intellect - AI.SCIENCE
Subscribers:
22,300
Published on ● Video Link: https://www.youtube.com/watch?v=ypqf7UUird4


Duration: 17:02
1,990 views
44

Speaker/author: Michael Zhang

For details including paper and slides, please visit https://aisc.ai.science/events/2019-09-22-lookahead-optimizer



Other Videos By LLMs Explained - Aggregate Intellect - AI.SCIENCE


2019-10-23Deep learning enables rapid identification of potent DDR1 kinase inhibitors | AISC
2019-10-22Restricted Boltzmann Machines for Collaborative Filtering | AISC
2019-10-15Location Intelligence Products: Goals and Challenges | AISC
2019-10-15RecSys, Reverse Engineering User's Needs and Desires | AISC
2019-10-08Breaking the Softmax Bottleneck via Learnable Monotonic Pointwise Non-linearities | AISC
2019-10-07DeepStack: Expert-Level Artificial Intelligence in Heads-Up No-Limit Poker | AISC
2019-09-30AISC Abstract Night September Edition | AISC
2019-09-26EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis
2019-09-26[Gated-SCNN] Gated Shape CNNs for Semantic Segmentation
2019-09-25MLOps: Overview of Machine Learning Operations on the Cloud | AISC
2019-09-24Lookahead Optimizer: k steps forward, 1 step back
2019-09-24Similarity of neural network representations revisited
2019-09-23Detecting Customer Complaint Escalation w/ Recurrent Neural Networks & Manually-Engineered Features
2019-09-23Graph Normalizing Flows
2019-09-23CNN Architectures for Large-Scale Audio Classification | AISC
2019-09-222019 AI Squared Forum Paper Track | AISC
2019-09-16Making of a conversational agent platform | AISC
2019-09-09A Survey of Singular Learning | AISC
2019-09-04Overview of Reinforcement Learning | AISC
2019-09-03Ernie 2.0: A Continual Pre-Training Framework for Language Understanding | AISC
2019-08-28Consistency by Agreement in Zero-shot Neural Machine Translation | AISC


Tags:
deep learning
machine learning