Troubleshooting AWS Batch Job Setup with Whisper AI | glowing telegram - Episode 137

Channel:
Subscribers:
542
Published on ● Video Link: https://www.youtube.com/watch?v=YXRF4Ov5sl0



Duration: 0:00
48 views
2


In this video, I delve into troubleshooting an AWS GPU batch job queue using EC2 spot instances, which initially faced provisioning issues due to spot instance quotas. I'll guide you through the process of understanding quota increases in AWS and share tips on navigating potential delays when setting up batch environments.

I also explore running the Whisper AI command-line program, focusing on developing a seamless way to handle data processing tasks. This includes reading data from Amazon S3, writing to DynamoDB, and extracting AWS-specific functionalities for local testing. We also discuss options for improving audio transcription tasks with OpenAI's Whisper, including tweaking model parameters and handling silence.

Throughout the video, I share my thought process, invite viewers to think critically about potential production issues, and emphasize the importance of a robust testing environment.

🔗 Check out my Twitch channel for more streams: https://www.twitch.tv/saebyn
GitHub: https://github.com/saebyn/glowing-telegram
Discord: https://discord.gg/N7xfy7PyHs




Other Videos By saebynVODs


2024-12-03Enhancing Video Player Controls with TypeScript | glowing telegram project - Episode 147
2024-12-01Improving a Video Editor with TypeScript w/ Multiple Files | glowing telegram project - Episode 146
2024-11-30Thinking about video segments in Typescript/React Video Editor | glowing telegram - Episode 145
2024-11-29Troubleshooting typescript/react video editor components | glowing telegram - Episode 144
2024-11-28Building a new Video Editor Frontend in TypeScript | glowing telegram - Episode 143
2024-11-27More deploying AWS Step Functions | glowing telegram - Episode 142
2024-11-26More Lambda Functions and Step Functions with AWS and Pulumi | glowing telegram - Episode 141
2024-11-25Streamlining AWS Lambda with Rust and Python | glowing telegram - Episode 140
2024-11-23Testing our Docker image + exploring EC2 spot instance cost | glowing telegram - Episode 139
2024-11-21Streamlining Audio Model Downloads and Video Processing with AWS | glowing telegram - Episode 138
2024-11-19Troubleshooting AWS Batch Job Setup with Whisper AI | glowing telegram - Episode 137
2024-11-18GPU batch job queue with AWS spot instances | glowing telegram - Episode 136
2024-11-16Making Our Rust/TS Web App Serverless with Pulumi and Python | glowing telegram - Episode 135
2024-11-14Serverless Audio Transcriber with Rust and Python Using Pulumi | glowing telegram - Episode 134
2024-11-12Optimizing ECS with Pulumi and Python | "glowing telegram" - Episode 133
2024-11-10"glowing telegram" serverless with pulumi and python - Episode 132
2024-10-23Optimizing AWS Batch Jobs for Efficient Video Ingestion | glowing-telegram project - Episode 131
2024-10-20Bringing in Pulumi and AWS properly, part 3 | glowing-telegram project - Episode 130
2024-10-18Bringing in Pulumi and AWS properly, part 2 | glowing-telegram project - Episode 129
2024-10-16Bringing in Pulumi and AWS properly, part 1 | glowing-telegram project - Episode 128
2024-10-10Wrapping up Pulumi experiments with AWS | glowing-telegram project - Episode 127