Memory Meets Psychology - Claude Plays Pokemon: How It works, How to improve it
34Inspired by Claude Plays Pokemon (CPP) ( https://www.twitch.tv/claudeplayspokemon), I will be implementing AgentJo Plays Pokemon with a few friends (advance thanks to Dylan Chia Tian for the livestream interface)! It will be open-sourced, and will be used to test out multimodal memory, goal-setting, adaptive memory updates and planning. See the github repo here: https://github.com/tanchongmin/agentjo/tree/main/projects/Pokemon
The first version of the CPP run saw it not being able to remember things, exploring the same things again with enthusiasm, and stuck in a loop in Mt. Moon.
The second version used context-based memory files to store memory for different contexts, and fares better. However, it still forgets important information.
I posit that human psychology can help in improving memory and adaptation.
We have emotions that can help to priorities memory encoding and retrieval - fear memories are stored more strongly, boring memories can be easily forgotten.
We also have the event boundary of the hippocampus to better store context when transiting between contexts. This is a useful thing to have in AI, so we can have memory that is more context-based when encoding.
Video: • Memory Meets Psychology - Claude Plays Pok...
~~
Slides: https://github.com/tanchongmin/agentjo/blob/main/paper_reviews/Claude Plays Pokemon Insights.pdf
~~
0:00 Introduction to Claude Plays Pokemon
1:34 AgentJo Plays Pokemon
3:51 Overview of Claude Plays Pokemon
23:16 Memory Issues
32:52 Psychology Insights for better memory retrieval and encoding
50:11 Image-based memory
58:25 Algorithms for navigation
1:03:57 Discussion
1:28:11 AgentJo Logo Design Competition
~~
AI and ML enthusiast. Likes to think about the essences behind breakthroughs of AI and explain it in a simple and relatable way. Also, I am an avid game creator.
Discord: https://discord.gg/bzp87AHJy5
LinkedIn: https://www.linkedin.com/in/chong-min-tan-94652288/
Online AI blog: https://delvingintotech.wordpress.com/
Twitter: https://twitter.com/johntanchongmin
Try out my games here: https://simmer.io/@chongmin