From TaskGen to AgentJo: Creating My Life Dream of Fast Learning and Adaptable Agents

Subscribers:
5,330
Published on ● Video Link: https://www.youtube.com/watch?v=u1BHvKRnhYY



Duration: 0:00
751 views
36


TaskGen is a framework that is a culmination of 5 years of thoughts during my PhD to build fast learning and adaptable agents. It uses a task-directed, memory-based mechanism to focus on tasks and learn from the environment, with knowledge sharing on a need-to-know basis.

AgentJo is the continuation of TaskGen, as we scale it to multiple memory abstraction spaces, multiple agent augmentations, adaptive learning, multi-agent learning and many more.

I am excited to see how AgentJo can scale and solve more real-world use cases!

I also demonstrate a live example of how learning can take place via reflection done after every subtask via a Rock, Scissors, Paper game. This improves on the baseline agent significantly and lets learning take place faster.

~~~

Repo: https://github.com/tanchongmin/agentjo
Slides: https://github.com/tanchongmin/agentjo/blob/main/resources/From_TaskGen_To_AgentJo.pdf

Related Work
TaskGen Paper Video:    • TaskGen Overview: Open-Sourced LLM Ag...  
TaskGen Paper: https://arxiv.org/abs/2407.15734v1

~~~

0:00 Introduction
5:30 Live Demo of AgentJo Reflection Wrapper
16:16 Chain of Thought and Reflection
17:53 StrictJSON
24:11 TaskGen
31:13 Current features of AgentJo
40:32 AgentJo Future Plans
1:03:20 Agent Wrappers
1:06:06 Memory Abstraction Spaces
1:10:28 Adaptive Learning
1:13:15 Multi-Agent Learning
1:26:22 Discussion + Discord Logo Design Competition

~~~

AI and ML enthusiast. Likes to think about the essences behind breakthroughs of AI and explain it in a simple and relatable way. Also, I am an avid game creator.

Discord: https://discord.gg/bzp87AHJy5
LinkedIn: https://www.linkedin.com/in/chong-min-tan-94652288/
Online AI blog: https://delvingintotech.wordpress.com/
Twitter: https://twitter.com/johntanchongmin
Try out my games here: https://simmer.io/@chongmin




Other Videos By John Tan Chong Min


2025-02-24Vibe Coding: How to use LLM prompts to code effectively!
2025-01-26PhD Thesis Overview (Part 2): LLMs for ARC-AGI, Task-Based Memory-Infused Learning, Plan for AgentJo
2025-01-20PhD Thesis Overview (Part 1): Reward is not enough; Towards Goal-Directed, Memory-based Learning
2024-12-04AgentJo CV Generator: Generate your CV by searching for your profile on the web!
2024-11-11Can LLMs be used in self-driving? CoMAL: Collaborative Multi-Agent LLM for Mixed Autonomy Traffic
2024-10-28From TaskGen to AgentJo: Creating My Life Dream of Fast Learning and Adaptable Agents
2024-10-21Tian Yu X John: Discussing Practical Gen AI Tips for Image Prompting
2024-10-08Jiafei Duan: Uncovering the 'Right' Representations for Multimodal LLMs for Robotics
2024-09-27TaskGen Tutorial 6: Conversation Wrapper
2024-09-26TaskGen Tutorial 5: External Functions & CodeGen
2024-09-24TaskGen Tutorial 4: Hierarchical Agents
2024-09-23TaskGen Tutorial 3: Memory
2024-09-19TaskGen Tutorial 2: Shared Variables and Global Context
2024-09-16Beyond Strawberry: gpt-o1 - Is LLM alone sufficient for reasoning?
2024-09-11TaskGen Tutorial 1: Agents and Equipped Functions
2024-09-11TaskGen Tutorial 0: StrictJSON
2024-09-10LLM-Modulo: Using Critics and Verifiers to Improve Grounding of a Plan - Explanation + Improvements
2024-09-06TaskGen: Co-create the best open-sourced LLM Agentic Framework together!
2024-08-21AriGraph (Part 2) - Knowledge Graph Construction and Retrieval Details
2024-08-13alphaXiv - Share Ideas, Build Collective Understanding, Interact with ANY open sourced paper authors
2024-07-30AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents