Tutorial #5: SymbolicAI - Automatic Retrieval Augmented Generation, Multimodal Inputs, User Packages

Channel:
Singapore John Tan Chong Min
Subscribers:
5,450
Published on ● Video Link: https://www.youtube.com/watch?v=0AqB6SEvRqo


Category:
Tutorial
Duration: 1:28:11
451 views
13

Marius and Leo give us a run-through of some of the new features of SymbolicAI.

We first go through a new engine that allows automated OS commands on your own command prompt/terminal. Then, we go through automatic retrieval augmented generation over documents, how to output format in json, how to do multi-modal (image and voice) processing, graph input processing. We also talk about performing self-healing code by debugging with a conversational agent which has memory of the conversation.

Lastly, we showcase some user packages which could perform custom user functions!

Jupyter Notebook can be downloaded at: https://github.com/tanchongmin/SymbolicAITutorial/blob/main/SymbolicAI_advanced.ipynb

SymbolicAI: https://symbolicai.readthedocs.io/en/latest/README.html
SymbolicAI Documentation: https://symbolicai.readthedocs.io/en/latest/

~~~~~~~~~~~~~~~~~~~

0:00 Introduction
1:08 Automated OS Commands
12:40 Processing Documents
14:16 Json Outputting Format
20:25 Document Retrieval
30:35 Multi-Modal Document Processing
38:06 Visualizing Graph Data
46:48 Debugging with Conversation Package - use this to incorporate memory to any function
1:05:14 User Packages
1:21:03 SymbolicAI Documentation
1:24:10 Future Work and Concluding Notes

~~~~~~~~~~~~~~~~~~~~

AI and ML enthusiast. Likes to think about the essences behind breakthroughs of AI and explain it in a simple and relatable way. Also, I am an avid game creator.

Discord: https://discord.gg/bzp87AHJy5
LinkedIn: https://www.linkedin.com/in/chong-min-tan-94652288/
Online AI blog: https://delvingintotech.wordpress.com/
Twitter: https://twitter.com/johntanchongmin
Try out my games here: https://simmer.io/@chongmin



Other Videos By John Tan Chong Min


2023-09-19Moving Beyond Probabilities: Memory as World Modelling
2023-09-05Symbolic Regression: Doing What LLMs cannot - Deriving Arbitrary Mathematical Relations!
2023-08-29LLM Agents as a System (Prelim Findings Sharing): An Attempt to solve a 2-player 2D Escape Room!
2023-08-23LLM as Pattern Machines(Part 2) - Goal Directed Decision Transformers, 10-Year Plan for Intelligence
2023-08-18Tutorial #9: Evolution Game v2: ChatGPT (Text) and Dall-E (Image) API Integration!
2023-08-17Tutorial #8: Create a Web Scraper using ChatGPT and Selenium!
2023-08-17Tutorial #7: Create a Chatbot with Gradio and ChatGPT!
2023-08-15LLMs as General Pattern Machines: Use Arbitrary Tokens to Pattern Match?
2023-08-08Tutorial #6: LangChain & StrictJSON Implementation of Knowledge Graph Question Answer with LLMs
2023-08-08Large Language Models and Knowledge Graphs: Merging Flexibility and Structure
2023-07-31Tutorial #5: SymbolicAI - Automatic Retrieval Augmented Generation, Multimodal Inputs, User Packages
2023-07-27How Llama 2 works: Ghost Attention, Quality Supervised Fine-tuning, RLHF for Safety and Helpfulness
2023-07-27Llama 2 vs ChatGPT
2023-07-11I-JEPA: Importance of Predicting in Latent Space
2023-07-09Gen AI Study Group Introductory Tutorial - Transformers, ChatGPT, Prompt Engineering, Projects
2023-07-03Tutorial #5: Strict JSON LLM Framework - Get LLM to output JSON exactly the way you want it!
2023-07-01Tutorial #4: SymbolicAI ChatBot In-Depth Demonstration (Tool Use and Iterative Processing)
2023-06-29How do we learn so fast? Towards a biologically plausible model for one-shot learning.
2023-06-20LLMs as a system to solve the Abstraction and Reasoning Corpus (ARC) Challenge!
2023-06-16Tutorial #3: Symbolic AI - Symbols, Operations, Expressions, LLM-based functions!
2023-06-13No more RL needed! LLMs for high-level planning: Voyager + Ghost In the Minecraft