Generative Python Transformer p.3 - Preprocessing Dataset

Generative Python Transformer p.3 - Preprocessing Dataset

Channel:
United States sentdex
Subscribers:
1,420,000
Published on ● Video Link: https://www.youtube.com/watch?v=PUr-4ouD0Xc


Duration: 33:00
14,753 views
417

Preprocessing the dataset in preparation to use it for training a transformer model with Huggingface's transformers library.

Neural Networks from Scratch book: https://nnfs.io
Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join
Discord: https://discord.gg/sentdex
Reddit: https://www.reddit.com/r/sentdex/
Support the content: https://pythonprogramming.net/support-donate/
Twitter: https://twitter.com/sentdex
Instagram: https://instagram.com/sentdex
Facebook: https://www.facebook.com/pythonprogramming.net/
Twitch: https://www.twitch.tv/sentdex



Other Videos By sentdex


2021-09-26Coding Adventure with Kaggle and Lux AI
2021-08-23Robot Dogs: A Programmer's Best Friend
2021-08-06What Can Huge Neural Networks do?
2021-08-02Neural Networks from Scratch - P.9 Introducing Optimization and derivatives
2021-07-23GPyT - Generative Python Transformer Model released (the off-brand Github Copilot)
2021-06-18Playing a Neural Network's version of GTA V: GAN Theft Auto
2021-06-05Neural Networks from Scratch - P.8 Implementing Loss
2021-05-29Generative Python Transformer p.6 - Testing larger model
2021-05-22Generative Python Transformer p.5 - Training and some testing of GPT-2 model
2021-05-15Generative Python Transformer p.4 - Tokenizing
2021-05-10Generative Python Transformer p.3 - Preprocessing Dataset
2021-05-07Generative Python Transformer p.2 - Raw Data Cleaning
2021-05-03Generative Python Transformer p.1 - Acquiring Raw Data
2021-04-30P.2 Chatbot with Mic input/Speaker output using Python, Jarvis, and DialoGPT
2021-04-26P.1 Chatbot with Mic input/Speaker output using Python, Jarvis, and DialoGPT
2021-04-232. Live coding Jarvis Transcriptions for Speech to Text Dataset p.2
2021-04-191. Live coding Jarvis Transcriptions for Speech to Text Dataset p.1
2021-04-16Conversational AI w/ Jarvis - checking out the API
2021-04-12Checking out one of the world’s first NVIDIA DGX Station A100s
2021-03-01Autoencoders in Python with Tensorflow/Keras
2021-01-30Cyber Python 2077 Part 2 - Getting to our objective


Tags:
python
programming