Can ChatGPT solve CodinGame/Google Kickstart problems?

Channel:
Singapore John Tan Chong Min
Subscribers:
5,330
Published on ● Video Link: https://www.youtube.com/watch?v=ruQjToLkB5Y


Duration: 1:46:00
1,095 views
5

Answer: Not much

It works pretty well on simple and linear types of problems, not so much for loops or advanced data structures!

Background: ChatGPT is trained using next token prediction firstly via self-supervised learning on all sorts of online data. Then, it is fine-tuned to several well-known benchmark datasets such as those for Natural Langauge Processing, coding, math. It is then further refined using Reinforcement Learning from Human Feedback (RLHF), which is the secret sauce why it feels good to us - it has been trained to sound plausible by some sample demonstrations from humans.

Can ChatGPT do well for code generation to solve competitive programming problems, just like AlphaCode?

0:00 Initial Overview of ChatGPT
7:20 CodinGame Clash of Code
50:12 CodinGame AI Fall Challenge (Just kidding)
58:20 CodinGame Easy/Medium Puzzles
1:37:15 Google Kickstart


Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/johncm99

Discord: https://discord.gg/fXCZCPYs
LinkedIn: https://www.linkedin.com/in/chong-min-tan-94652288/
Online AI blog: https://delvingintotech.wordpress.com/.
Twitter: https://twitter.com/johntanchongmin
Try out my games here: https://simmer.io/@chongmin



Other Videos By John Tan Chong Min


2023-03-21Tokenize any input, even continuous vectors! - Residual Vector Quantization - VALL-E (Part 2)
2023-03-07Using Transformers to mimic anyone's voice! - VALL-E (Part 1)
2023-02-28Learning Part-Whole Structure by Chunking - More Efficient than Deep Learning!!!
2023-02-21High-level planning with large language models - SayCan
2023-02-13Learning, Fast and Slow: Towards Fast and Adaptable Agents in Changing Environments
2023-02-07Using Logic Gates as Neurons - Deep Differentiable Logic Gate Networks!
2023-01-31Learn from External Memory, not just Weights: Large-Scale Retrieval for Reinforcement Learning
2023-01-17How ChatGPT works - From Transformers to Reinforcement Learning with Human Feedback (RLHF)
2023-01-09HyperTree Proof Search - Automated Theorem Proving with AlphaZero and Transformers!
2022-12-23CodinGame Fall Challenge 2022: A First Look (managed to get to Silver!)
2022-12-21Can ChatGPT solve CodinGame/Google Kickstart problems?
2022-12-19Reinforcement Learning Fast and Slow: Goal-Directed and Memory Retrieval Mechanism!
2022-12-12A New Framework of Memory for Learning (Part 1)
2022-11-14Hippocampal Replay for Learning (Full Length with Questions)
2022-11-14Hippocampal Replay for Learning (3 min summary)
2022-11-07AlphaTensor: Using Reinforcement Learning for Efficient Matrix Multiplication
2022-10-27Playing Go on TyGem and learning from AI (~ 3 kyu)
2022-10-13Heroes of Might and Magic III - Armageddon's Blade Campaign (First Playthrough) - Final!!!
2022-10-13Heroes of Might and Magic III - Armageddon's Blade Campaign (First Playthrough) - Part 6
2022-10-11Playing Go on Tygem + AI Analysis (~4 kyu)
2022-10-11Heroes of Might and Magic III - Armageddon's Blade Campaign (First Playthrough) - Part 5


Tags:
games
twitch