Scaling AI Model Training and Inferencing Efficiently with PyTorch

Channel:
United States IBM Technology
Subscribers:
1,190,000
Published on ● Video Link: https://www.youtube.com/watch?v=85RfazjDPwA


Duration: 18:29
3,512 views
123

Learn more about PyTorch → https://ibm.biz/BdSx57
Learn more about Llama → https://ibm.biz/BdSx53
LLaMa Recipes on Github → https://ibm.biz/BdSx5Q
Foundation Model Stack on GitHub → https://ibm.biz/foundation-model-stack

PyTorch is an open source Python based framework for AI model training and inferencing, but it's still a resource intensive task. In this video, Raghu Kiran Ganti from IBM Research and Suraj Subramanian from Meta discuss how to increase efficiencies in both cost and time for AI workloads using PyTorch features like fully sharded data parallel (FSDP) and TorchDynamo.

Get started for free on IBM Cloud → https://ibm.biz/sign-up-now
Subscribe to see more videos like this in the future → http://ibm.biz/subscribe-now

#PyTorchConf #pytorch #ai



Other Videos By IBM Technology


2023-11-01Backstage.io - An Open Source Portal for Taming Developer Chaos
2023-10-31Got Sensitive Cloud Data? Data Security Posture Management Helps Protect It
2023-10-30IBM Tech Now: IBM and Equinix, the White House cybersecurity plan and an award for QRadar SIEM
2023-10-27Hypnotized AI and Large Language Model Security
2023-10-26The Rise of Generative AI for Business
2023-10-25Common Container Mistakes and How to Avoid Them
2023-10-24AIOps for Mainframe and Apps Better Together
2023-10-23Using Retrieval Augmented Generation with a Large Language Model AI Chatbot
2023-10-20Why GraphQL Needs API Management
2023-10-18What is a Remote Access Trojan (RAT)?
2023-10-16Scaling AI Model Training and Inferencing Efficiently with PyTorch
2023-10-16IBM Tech Now: AI and fantasy football and generative AI tools for criminals
2023-10-13Build a Chatbot with AI in 5 minutes
2023-10-11What is PyTorch? (Machine/Deep Learning)
2023-10-09Will AI Help or Hurt Cybersecurity? Definitely!
2023-10-06What is GraphQL?
2023-10-03Why Are There So Many Foundation Models?
2023-10-02IBM Tech Now: AI on IBM Z, IBM Maximo Application Suite 8.11 and IBM NS1 Connect
2023-10-01Securing Your IoT Devices
2023-09-28Containerization Strategy
2023-09-26Mainframe Z and AI


Tags:
IBM Cloud
pytorch
deeplearning
deep learning
machine learning
ML
AI
Artificial Intelligence
fully sharded data parallel
FSDP
GPU
CPU
distributeddataparallel
DDP
infiniband
ethernet
facebook
meta
meta ai
Facebook ai
Eager Mode
Eagermode
PyTorchConf