Cloud-Native Pytest Tips and Tricks from Ground Zero
Learn to master Pytest via these tips and tricks.
00:00 Intro
01:00 Key Concepts in Testing
10:00 Key Testing Terminology
15:00 Kazien equals DevOps
18:22 Setup Github
23:00 Setup Github Codespaces
25:00 Explaining Python pip freeze
33:00 Create Makefile
37:00 Pin requirements.txt
38:00 Cloud development environment concepts: AWS Cloud9 to Github Codespaces
43:00 Setup Github Actions
44:00 Configuring Matrix testing of Python
48:00 Building simple Python scripts as part of CI/CD and linting them with Pylint
56:00 Setup AWS CloudShell for CI/CD
01:00:09 Adding Python 3.7, 3.8, 3.9 and 3.10 to Matrix testing
01:04:00 Setup AWS Cloud9
01:11:00 Refactoring Python project to include testing directory and library directory
01:19:00 Setup Python Test Coverage
01:22:00 Adding Pytest to Github Actions YAML file
01:29:00 Creating Python library file that searches wikipedia and tests it
01:36:00 Adding Python Fire command-line tool
01:42:00 Running Pytests by search expression
01:44:30 Running Pytests by specifying tests
01:46:00 Marking tests in Pytest and avoiding slow tests
01:48:00 Profiling testing speed using Pytest
01:56:39 Doing distributed testing with xdist to spread tests to multiple cores
02:05:21 Created distributed testing group to distribute to multiple cores
02:09:00 Setup 32 Core 60GB RAM Cloud9 Machine to run massively parallel Pytests
02:13:58 Running distributed testing that doubles the speed of the tests
02:23:00 Setup Cloud-Native AWS Code Build testing with buildspec.yml that does distributed testing to 8 Core Build client
If you enjoyed this video, here are additional resources to look at:
Coursera + Duke Specialization: Building Cloud Computing Solutions at Scale Specialization: https://www.coursera.org/specializations/building-cloud-computing-solutions-at-scale
Python, Bash, and SQL Essentials for Data Engineering Specialization: https://www.coursera.org/specializations/python-bash-sql-data-engineering-duke
AWS Certified Solutions Architect - Professional (SAP-C01) Cert Prep: 1 Design for Organizational Complexity:
https://www.linkedin.com/learning/aws-certified-solutions-architect-professional-sap-c01-cert-prep-1-design-for-organizational-complexity/design-for-organizational-complexity?autoplay=true
O'Reilly Book: Practical MLOps: https://www.amazon.com/Practical-MLOps-Operationalizing-Machine-Learning/dp/1098103017
O'Reilly Book: Python for DevOps: https://www.amazon.com/gp/product/B082P97LDW/
Pragmatic AI: An Introduction to Cloud-based Machine Learning: https://www.amazon.com/gp/product/B07FB8F8QP/
Pragmatic AI Labs Book: Python Command-Line Tools: https://www.amazon.com/gp/product/B0855FSFYZ
Pragmatic AI Labs Book: Cloud Computing for Data Analysis: https://www.amazon.com/gp/product/B0992BN7W8
Pragmatic AI Book: Minimal Python: https://www.amazon.com/gp/product/B0855NSRR7
Pragmatic AI Book: Testing in Python: https://www.amazon.com/gp/product/B0855NSRR7
Subscribe to Pragmatic AI Labs YouTube Channel: https://www.youtube.com/channel/UCNDfiL0D1LUeKWAkRE1xO5Q
Subscribe to 52 Weeks of AWS Podcast: https://52-weeks-of-cloud.simplecast.com
View content on noahgift.com: https://noahgift.com/
View content on Pragmatic AI Labs Website: https://paiml.com/
#aws #pytest #python