How DeepMind's AlphaGo Defeated Lee Sedol | Two Minute Papers #53

Channel:
Hungary Two Minute Papers
Subscribers:
1,720,000
Published on ● Video Link: https://www.youtube.com/watch?v=a-ovvd_ZrmA


Category:
Let's Play
Duration: 5:57
15,433 views
398

This time around, Google DeepMind embarked on a journey to write an algorithm that plays Go. Go is an ancient chinese board game where the opposing players try to capture each other's stones on the board. Behind the veil of this deceptively simple ruleset, lies an enormous layer of depth and complexity. As scientists like to say, the search space of this problem is significantly larger than that of chess. So large, that one often has to rely on human intuition to find a suitable next move, therefore it is not surprising that playing Go on a high level is, or maybe was widely believed to be intractable for machines. The result is Google DeepMind's AlphaGo, the deep learning technique that defeated a professional player and world champion, Lee Sedol.

What it also important to note is that the techniques used in this algorithm are general, and can be used for a large number of different tasks. By this, I mean not AlphaGo specifically, but the Monte Carlo Tree Search, the value network and deep neural networks.

______________________

The paper "Mastering the Game of Go with Deep Neural Networks and Tree Search" is available here:
https://storage.googleapis.com/deepmind-data/assets/papers/deepmind-mastering-go.pdf
http://www.nature.com/nature/journal/v529/n7587/full/nature16961.html

A great Go analysis video by Brady Daniels. Make sure to check it out and subscribe if you like what you see there!
https://www.youtube.com/watch?v=dOQsYWxMNJQ

The mentioned post on the Go reddit:
https://www.reddit.com/r/baduk/comments/49y17z/the_true_strength_of_alphago/

Some clarification on what part of the algorithm is specific to Go and how:
https://news.ycombinator.com/item?id=11280744

Go board image credits (all CC BY 2.0):
Renato Ganoza - https://flic.kr/p/7nX4kK
Jaro Larnos - https://flic.kr/p/dDeQU9
Luis de Bethencourt - https://flic.kr/p/4c5RaR

WE WOULD LIKE TO THANK OUR GENEROUS SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE:
Sunil Kim, Vinay S.

Subscribe if you would like to see more of these! - http://www.youtube.com/subscription_center?add_user=keeroyz

The background of the thumbnail image is the property of Google DeepMind.
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu

Károly Zsolnai-Fehér's links:
Patreon → https://www.patreon.com/TwoMinutePapers
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/



Other Videos By Two Minute Papers


2016-05-01Training Deep Neural Networks With Dropout | Two Minute Papers #62
2016-04-28Narrow Band Liquid Simulations | Two Minute Papers #61
2016-04-24No Such Thing As Artificial Intelligence | Two Minute Papers #60
2016-04-1410 Even Cooler Deep Learning Applications | Two Minute Papers #59
2016-04-10The Dunning-Kruger Effect | Two Minute Papers #58
2016-04-04From Doodles To Paintings With Deep Learning | Two Minute Papers #57
2016-03-30Overfitting and Regularization For Deep Learning | Two Minute Papers #56
2016-03-27How The Witness Teaches Scientific Thinking
2016-03-24Decision Trees and Boosting, XGBoost | Two Minute Papers #55
2016-03-203D Depth From a Single Photograph | Two Minute Papers #54
2016-03-15How DeepMind's AlphaGo Defeated Lee Sedol | Two Minute Papers #53
2016-03-1310 More Cool Deep Learning Applications | Two Minute Papers #52
2016-03-065000 Fellow Scholars Special! | Two Minute Papers
2016-03-02Awesome Research For Everyone! - Two Minute Papers Channel Trailer
2016-03-02How To Get Started With Machine Learning? | Two Minute Papers #51
2016-02-28Interactive Photo Recoloring | Two Minute Papers #50
2016-02-24Deep Learning Program Learns to Paint | Two Minute Papers #49
2016-02-21Artistic Manipulation of Caustics | Two Minute Papers #48
2016-02-18Should You Take the Stairs at Work? (For Weight Loss) | Two Minute Papers #47
2016-02-15What is Impostor Syndrome? | Two Minute Papers #46
2016-02-10Biophysical Skin Aging Simulations | Two Minute Papers #45


Tags:
two minute papers
deepmind deep learning
alphago
alphago lee sedol
lee sedol
deepmind lee sedol
deepmind go
lee sedol go
deep learning
monte carlo tree search
value network
value network go
mastering the game of go with deep neural networks and tree search
deep neural network
deepmind neural network
go neural network
go deep neural network
deep q learning
deep q-learning
dqn
deepmind dqn
deepmind deep q-learning
alphago deepmind
alphago google