Building an API with Python, Rust, Pulumi, and AWS: DynamoDB Integration - Episode 166
7In this video, I deep dive into building an API using Python, Rust, Pulumi, and AWS, focusing on critical aspects like data migration, DynamoDB integration, and adding authentication with AWS Cognito. Throughout the session, I explore automating processes, ensuring data accuracy, and explain strategies for structuring APIs and handling user authentication via API Gateway.
🔗 Check out my Twitch channel for more streams: https://www.twitch.tv/saebyn
GitHub: https://github.com/saebyn
Discord: https://discord.gg/N7xfy7PyHs
I start by sharing the challenges and solutions for migrating data from PostgreSQL to DynamoDB, ensuring no duplication and maintaining data integrity. Next, I walk through the setup of episodes and streams data models, refine how metadata is processed, and think about automating manual steps in the ingestion workflow.
Later, I introduce the concept of securing application endpoints by incorporating Cognito user authentication in Pulumi scripts. This involves creating and configuring Cognito user pools, setting up authorizers in API Gateway, and implementing token-based access controls for API endpoints.
I also experiment with testing API calls, discuss security considerations when exposing APIs, and explore tools like the REST client for debugging workflows. As I address real-world issues, such as caching and token invalidation, I ensure the API setup is user-authentication compliant and production-ready.
Towards the end, I reflect on restructuring API resource definitions, renaming components for clarity, and set the groundwork for building comprehensive CRUD operations for various resources like streams, episodes, and video clips. Throughout the video, I also share plans for improving the project’s overall architecture, documenting lessons learned, and planning next steps for enhanced functionality.