Generative AI: Input & Pre-training
Channel:
Subscribers:
444,000
Published on ● Video Link: https://www.youtube.com/watch?v=JO9MgO1Zp3E
49Learn how large language models go through a pre-training process to begin understanding language, then break up it's input into smaller bite-sized pieces.
This video is a part of the Exploring Generative AI curriculum - learn more at https://code.org/ai
Stay in touch with us on social media:
• Twitter: https://twitter.com/codeorg
• Facebook: https://www.facebook.com/Code.org
• Instagram: https://instagram.com/codeorg
• TikTok: https://tiktok.com/@code.org
• LinkedIn: https://www.linkedin.com/company/code-org
• Medium: https://medium.com/@codeorg
Help make our work possible with a donation at http://code.org/donate!
Other Videos By Code.org
| 2025-02-18 | Aloe Blacc, Singer Songwriter |
| 2024-12-12 | Make the Invisible Visible With One Hour of Code |
| 2024-12-02 | Hour of Code: Make The Invisible Visible | Official Trailer |
| 2024-11-26 | One Hour Can Make The Invisible Visible |
| 2024-11-14 | Music Lab: Shakira |
| 2024-11-13 | Music Lab: Jam Session Intro |
| 2024-10-15 | Generative AI: Output & Probabilities |
| 2024-10-15 | Generative AI: Attention |
| 2024-10-15 | Generative AI: Processing & Neural Networks |
| 2024-10-15 | Generative AI: Storage & Embeddings |
| 2024-10-15 | Generative AI: Input & Pre-training |
| 2024-09-09 | Code the fun: with Transformers One! |
| 2024-07-19 | BBC's The Human Component: Code.org |
| 2024-07-16 | Sin Conexión - Mis Amigos Robóticos |
| 2024-07-16 | Sin Conexión - Girar y girar |
| 2024-07-16 | ¡Muévelo, muévelo! |
| 2024-07-16 | El gran evento |
| 2024-07-16 | Sin Conexión - Mapas Felices |
| 2024-07-11 | Intro to Game Design |
| 2024-06-28 | Beyond Binary: Computer Science is for Everyone |
| 2024-06-24 | Getting Started with Code.org: Progress Feedback & Assessment |