Go-Explore: Solving Hard Exploration Problems

Channel:
Singapore John Tan Chong Min
Subscribers:
5,500
Published on ● Video Link: https://www.youtube.com/watch?v=oyyOa_nJeDs


Torchlight
Game:
Torchlight (2009)
Duration: 1:09:07
56 views
2

Go-Explore uses a two-step approach: Go (return to previous saved state), then Explore (explore from that state).

It manages to solve the hardest RL problems in the Atari domain, mainly Montezuma's Revenge, and reaches SOTA score for all other Atari games with the right abstraction.

Links to paper:
Go-Explore: https://arxiv.org/pdf/1901.10995.pdf
First return, then explore (follow-up on Go-Explore with goal-conditioned rewards): https://arxiv.org/pdf/2004.12919.pdf

0:00 Introduction
3:37 Montezuma’s Revenge Video
6:34 Intrinsic Motivation approaches
13:41 Detachment
15:52 Derailment
19:50 Torchlight Analogy
24:00 Go-Explore Overview
33:28 Updating the Memory Archive
35:34 Example
41:36 Robustify Phase
44:25 Discussion

Online AI blog: https://delvingintotech.wordpress.com/.
LinkedIn: https://www.linkedin.com/in/chong-min-tan-94652288/
Twitch: https://www.twitch.tv/johncm99
Twitter: https://twitter.com/johntanchongmin
Try out my games here: https://simmer.io/@chongmin



Other Videos By John Tan Chong Min


2022-10-11Heroes of Might and Magic III - Armageddon's Blade Campaign (First Playthrough) - Part 5
2022-10-11Heroes of Might and Magic III - Armageddon's Blade Campaign (First Playthrough) - Part 4
2022-10-10Playing Go on Tygem + AI Analysis (~4 kyu)
2022-10-10Heroes of Might and Magic III - Armageddon's Blade Campaign (First Playthrough) - Part 3
2022-10-10Heroes of Might and Magic III - Armageddon's Blade Campaign (First Playthrough) - Part 2
2022-10-10Heroes of Might and Magic III - Armageddon's Blade Campaign (First Playthrough) - Part 1
2022-10-09Playing Go on Tygem + AI analysis tool (~ 4 kyu)
2022-10-06Playing Go on Tygem + AI analysis tool (~ 4 kyu)
2022-10-05Getting back to Go again after a while - Tygem + checking out their AI analysis tool (~ 5 kyu)
2022-10-03Nature vs Nurture: Algorithms vs Neural Networks
2022-09-05Go-Explore: Solving Hard Exploration Problems
2022-08-22Neural Sheaf Diffusion: Graphs X Topology
2022-08-16Decision Tree (Overall Code Walkthrough)
2022-08-16Decision Tree from scratch! (Part 2)
2022-08-16Decision Tree from scratch! (Part 1)
2022-08-08GATO by DeepMind: One Transformer to rule them all?
2022-08-01Bandlab - Aerith Theme
2022-07-27Bandlab - One Winged Angel Theme (Part 3)
2022-07-27Bandlab - One Winged Angel Theme (Part 4)
2022-07-27Bandlab - One Winged Angel Theme (Final!)
2022-07-27Bandlab - One Winged Angel Theme (Part 5)


Other Statistics

Torchlight Statistics For John Tan Chong Min

There are 56 views in 1 video for Torchlight. About an hours worth of Torchlight videos were uploaded to his channel, less than 0.37% of the total video content that John Tan Chong Min has uploaded to YouTube.