Bringing in Pulumi and AWS properly, part 2 | glowing-telegram project - Episode 129

Channel:
Subscribers:
542
Published on ● Video Link: https://www.youtube.com/watch?v=EoN2JNbUEVQ



Duration: 0:00
61 views
2


In this video, I walk you through making significant strides in transforming our Rust/TypeScript web app into a serverless architecture using Pulumi and AWS services. We tackle AWS resources management, configure batch job definitions, and manage S3 buckets without compromising necessary data. I also maneuver through some technical hurdles with async programming in Rust, notably with Tokyo.

I begin by ensuring our AWS infrastructure can remove certain resources while keeping our protected S3 bucket intact. We explore batch job definitions and handle some persistent issues related to deleting resources like the Elastic Container Repository.

Moving into Rust coding, I approach async function errors and delve into Tokyo's async runtime, figuring out efficient ways to handle errors while setting up our configurations. I also explain the importance of prefixes in our bucket configuration to store audio extraction results, keyframes, and metadata in DynamoDB.

A major portion of the stream focuses on strategizing multi-tasking using Rust's concurrency model. We explore how to perform tasks in parallel, akin to JavaScript's Promise.all, enabling us to extract audio, key frames, and gather metadata concurrently.

Towards the end, I outline the next steps, which include converting our TypeScript Pulumi code to Python, setting up security groups, compute environments, and role configurations to ensure our serverless architecture functions seamlessly.

📅 This stream was recorded on 2024-09-15.

Join me in the next stream for more coding adventures, and don't forget to check out the links below to stay connected with our community.

🔗 Check out my Twitch channel for more streams: https://www.twitch.tv/saebyn
GitHub: https://github.com/saebyn/glowing-telegram
Discord: https://discord.gg/N7xfy7PyHs




Other Videos By saebynVODs


2024-11-23Testing our Docker image + exploring EC2 spot instance cost | glowing telegram - Episode 139
2024-11-21Streamlining Audio Model Downloads and Video Processing with AWS | glowing telegram - Episode 138
2024-11-19Troubleshooting AWS Batch Job Setup with Whisper AI | glowing telegram - Episode 137
2024-11-18GPU batch job queue with AWS spot instances | glowing telegram - Episode 136
2024-11-16Making Our Rust/TS Web App Serverless with Pulumi and Python | glowing telegram - Episode 135
2024-11-14Serverless Audio Transcriber with Rust and Python Using Pulumi | glowing telegram - Episode 134
2024-11-12Optimizing ECS with Pulumi and Python | "glowing telegram" - Episode 133
2024-11-10"glowing telegram" serverless with pulumi and python - Episode 132
2024-10-23Optimizing AWS Batch Jobs for Efficient Video Ingestion | glowing-telegram project - Episode 131
2024-10-20Bringing in Pulumi and AWS properly, part 3 | glowing-telegram project - Episode 130
2024-10-18Bringing in Pulumi and AWS properly, part 2 | glowing-telegram project - Episode 129
2024-10-16Bringing in Pulumi and AWS properly, part 1 | glowing-telegram project - Episode 128
2024-10-10Wrapping up Pulumi experiments with AWS | glowing-telegram project - Episode 127
2024-10-08Transforming Rust Web App into a Serverless AWS Solution | glowing-telegram project - Episode 126
2024-10-06Deploying Serverless Rust with Pulumi | glowing-telegram project - Episode 125
2024-10-04Exploring Pulumi and LocalStack for AWS Development - glowing telegram project - Episode 124
2024-10-02Deploying AWS Lambda with Pulumi and LocalStack - glowing telegram project - Episode 123
2024-09-29Exploring AWS Services with LocalStack & Pulumi | glowing-telegram project - Episode 122
2024-09-27Consolidating OAuth Token Handling for YouTube and Twitch | Glowing-Telegram project - Episode 121
2024-09-26Optimizing OAuth Flow for Rust APIs with React-Admin | Glowing-Telegram project - Episode 120
2024-09-25Debugging OAuth2 Integration for Rust APIs & React-Admin | glowing-telegram project - Episode 119