Streamlining AWS Lambda with Rust and Python | glowing telegram - Episode 140

Channel:
Subscribers:
542
Published on ● Video Link: https://www.youtube.com/watch?v=z16djX-Kke4



Duration: 0:00
54 views
2


In this video, I delve into the intricacies of enhancing the Glowing Telegram project by configuring AWS Lambda functions using Rust and Python. We begin by addressing some issues encountered in previous streams, particularly focusing on the setup involving GPU resources and the challenges faced with DynamoDB’s storage constraints when handling audio transcriptions via OpenAI's Whisper.

We'll explore the concept of processing video files with step functions to orchestrate the transcription and summarization pipeline. This involves leveraging OpenAI's API for creating structured outputs and implementing JSON schema to enable seamless, schema-compliant data retrieval. I discuss the development and refinement of prompt engineering strategies to optimize these processes.

Additionally, I tackle challenges related to deploying AWS Lambda functions using Pulumi, transitioning from interactive to batch processing for more efficient workflows, and coding a Lambda function from scratch.

🔗 Check out my Twitch channel for more streams: https://www.twitch.tv/saebyn
GitHub: https://github.com/saebyn/glowing-telegram
Discord: https://discord.gg/N7xfy7PyHs




Other Videos By saebynVODs


2024-12-08Enhancing Video Summarization with OpenAI API and JSON Schema | Episode 150
2024-12-06Refining AWS Lambda Transcription Processing with Rust | Episode 149
2024-12-04Implementing Seamless Video Transitions in TypeScript | glowing telegram project - Episode 148
2024-12-03Enhancing Video Player Controls with TypeScript | glowing telegram project - Episode 147
2024-12-01Improving a Video Editor with TypeScript w/ Multiple Files | glowing telegram project - Episode 146
2024-11-30Thinking about video segments in Typescript/React Video Editor | glowing telegram - Episode 145
2024-11-29Troubleshooting typescript/react video editor components | glowing telegram - Episode 144
2024-11-28Building a new Video Editor Frontend in TypeScript | glowing telegram - Episode 143
2024-11-27More deploying AWS Step Functions | glowing telegram - Episode 142
2024-11-26More Lambda Functions and Step Functions with AWS and Pulumi | glowing telegram - Episode 141
2024-11-25Streamlining AWS Lambda with Rust and Python | glowing telegram - Episode 140
2024-11-23Testing our Docker image + exploring EC2 spot instance cost | glowing telegram - Episode 139
2024-11-21Streamlining Audio Model Downloads and Video Processing with AWS | glowing telegram - Episode 138
2024-11-19Troubleshooting AWS Batch Job Setup with Whisper AI | glowing telegram - Episode 137
2024-11-18GPU batch job queue with AWS spot instances | glowing telegram - Episode 136
2024-11-16Making Our Rust/TS Web App Serverless with Pulumi and Python | glowing telegram - Episode 135
2024-11-14Serverless Audio Transcriber with Rust and Python Using Pulumi | glowing telegram - Episode 134
2024-11-12Optimizing ECS with Pulumi and Python | "glowing telegram" - Episode 133
2024-11-10"glowing telegram" serverless with pulumi and python - Episode 132
2024-10-23Optimizing AWS Batch Jobs for Efficient Video Ingestion | glowing-telegram project - Episode 131
2024-10-20Bringing in Pulumi and AWS properly, part 3 | glowing-telegram project - Episode 130