Google DeepMind's Deep Q-Learning & Superhuman Atari Gameplays | Two Minute Papers #27

Channel:

Two Minute Papers

Subscribers:

1,720,000

Published on November 22, 2015 1:19:15 PM ● Video Link: https://www.youtube.com/watch?v=Ih8EfvOzBOY

Category:

Let's Play

Duration: 3:50

48,112 views

797

Google DeepMind implemented an artificial intelligence program using deep reinforcement learning that plays Atari games and improves itself to a superhuman level. The technique is called deep Q-learning, it uses a combination of deep neural networks and reinforcement learning, and it is capable of playing many Atari games as good or better than humans. After presenting their initial results with the algorithm, Google almost immediately acquired the company for several hundred million dollars, hence the name Google DeepMind. I am sure that this is one of the biggest triumphs of deep learning, especially given the fact that now the first few successful experiments for 3D games are out there!

________________________

The Nature paper "Human-level control through deep reinforcement learning" is available here:
http://www.nature.com/nature/journal/v518/n7540/full/nature14236.html
http://www.cs.swarthmore.edu/~meeden/cs63/s15/nature15b.pdf

The code is available here:
https://sites.google.com/a/deepmind.com/dqn/

Ilya Kuzovkin's fork with visualization:
https://github.com/kuz/DeepMind-Atari-Deep-Q-Learner

This configuration file will run Ilya Kuzovkin's version with less than 1GB of VRAM:
http://cg.tuwien.ac.at/~zsolnai/wp/wp-content/uploads/2015/03/run_gpu

Recommended for you:
Artificial Neural Networks and Deep Learning - https://www.youtube.com/watch?v=rCWTOOgVXyE&list=PLujxSBD-JXgnqDD1n-V30pKtp6Q886x7e&index=13
Recurrent Neural Network Writes Sentences About Images - https://www.youtube.com/watch?v=e-WB4lfg30M&list=PLujxSBD-JXgnqDD1n-V30pKtp6Q886x7e&index=15
Deep Neural Network Learns Van Gogh's Art - https://www.youtube.com/watch?v=-R9bJGNHltQ&list=PLujxSBD-JXgnqDD1n-V30pKtp6Q886x7e&index=22
Terrain Traversal with Reinforcement Learning - https://www.youtube.com/watch?v=_yjHPu1aYCY&list=PLujxSBD-JXgnqDD1n-V30pKtp6Q886x7e&index=9

Subscribe if you would like to see more of these! - http://www.youtube.com/subscription_center?add_user=keeroyz

The thumbnail was made by moparx - https://flic.kr/p/76foMV
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu

Károly Zsolnai-Fehér's links:
Patreon → https://www.patreon.com/TwoMinutePapers
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/