MLOps Platforms From Zero: Databricks, MLFlow/MLRun/SKLearn

Channel:
United States Pragmatic AI Labs
Subscribers:
17,700
Published on ● Video Link: https://www.youtube.com/watch?v=PUXhWZQW8BI


Duration: 2:26:24
2,040 views
67

This video focuses on creating MLOps platforms using databricks, AutoML, SKLearn, and AWS.

00:00 Intro
01:20 Starting an MLOps project
11:14 Setup CI/CD
18:17 Invoke ML Library Code
28:24 End to End MLOps with Databricks to AWS Containers Diagram
30:41 Spinning up Databricks Cluster
37:21 Doing Pandas to Spark
40:00 Creating Fake News Classifier using Kaggle and AutoML
50:19 Creating Databricks AutoML Experiment
56:00 Viewing Databricks AutoML Experiment notebook
1:01:34 Registering models with Databricks
1:05:00 Setting up Inference endpoint with the Databricks platform
1:11:40 Using Github CodeSpaces to serve out downloaded Databricks model with MLFlow
1:20:00 Using FastAPI to serve Swagger documentation of MLFlow model
1:37:24 Feature Store Capabilities of Iguazio
1:44:00 Using AWS Cloud9 to develop containerized ML Models
1:51:00 Using AWS App Runner to serve out containerized model

View Source Code Here: https://github.com/noahgift/mlflow-project-best-practices

If you enjoyed this video, here are additional resources to look at:

Coursera + Duke Specialization: Building Cloud Computing Solutions at Scale Specialization: https://www.coursera.org/specializations/building-cloud-computing-solutions-at-scale

Python, Bash and SQL Essentials for Data Engineering Specialization: https://www.coursera.org/specializations/python-bash-sql-data-engineering-duke

O'Reilly Book: Practical MLOps: https://www.amazon.com/Practical-MLOps-Operationalizing-Machine-Learning/dp/1098103017

O'Reilly Book: Python for DevOps: https://www.amazon.com/gp/product/B082P97LDW/

Pragmatic AI: An Introduction to Cloud-based Machine Learning: https://www.amazon.com/gp/product/B07FB8F8QP/

Pragmatic AI Labs Book: Python Command-Line Tools: https://www.amazon.com/gp/product/B0855FSFYZ

Pragmatic AI Labs Book: Cloud Computing for Data Analysis: https://www.amazon.com/gp/product/B0992BN7W8


Pragmatic AI Book: Minimal Python: https://www.amazon.com/gp/product/B0855NSRR7

Pragmatic AI Book: Testing in Python: https://www.amazon.com/gp/product/B0855NSRR7

Subscribe to Pragmatic AI Labs YouTube Channel: https://www.youtube.com/channel/UCNDfiL0D1LUeKWAkRE1xO5Q

View content on noahgift.com: https://noahgift.com/

View content on Pragmatic AI Labs Website: https://paiml.com/



Other Videos By Pragmatic AI Labs


2022-04-1252 Weeks of Swift: Episode 11 - Methods
2022-04-08Learn Python in five Minutes with Colab Notebook
2022-04-08Refactoring a Python script into a library called by Python Click CLI
2022-04-08Quickstart Python Fire Command Line Interface (CLI)
2022-04-07Getting started with AWS Lambda and Step Functions
2022-04-07Functions to Containerized Microservice Continuous Delivery to AWS App Runner with Fast API
2022-04-0552 weeks swift properties
2022-04-0552 weeks aws solutions architect automate infrastructure with Cloud Formation, Beanstalk. Opsworks
2022-04-0552 Weeks AWS: Episode 18-Solutions Architect Continued-Automate Infra
2022-04-0552 Weeks of Swift: Episode 10 - Properties
2022-03-22MLOps Platforms From Zero: Databricks, MLFlow/MLRun/SKLearn
2022-03-1752weeks aws episode17 sa elasticity
2022-03-1752weeks swift classes
2022-03-17Functions from zero
2022-03-1652 Weeks AWS: Episode 17-Solutions Architect Continued-Elasticity
2022-03-1552 Weeks of Swift: Structures and Classes
2022-03-1052 weeks swift enumerations
2022-03-1052 weeks aws secure user
2022-03-092 Weeks AWS: Episode 16-Solutions Architect Continued
2022-03-0852 Weeks of Swift: Episode 8-Enumerations
2022-03-0452weeks episode7 swift closures