PyTorch Export Quantization with Intel GPUs | Intel Software

Subscribers:
256,000
Published on ● Video Link: https://www.youtube.com/watch?v=nek7u5scFU0



Duration: 0:00
13,337 views
74


Quantization using PyTorch torch.export graph mode automates operator fusion and insertion of observers, and delivers better quantization results than using eager mode. This is available on Intel GPUs starting with PyTorch 2.7.

Learn how torch.export quantization works, and how to get started, including how to generate the computational graph, prepare the model and quantize it, and then compile the quantized model for Intel GPUs.

Resource Links:
Get started with PyTorch on Intel GPUs: https://pytorch.org/docs/stable/notes/get_start_xpu.html
torch.export quantization example on Intel GPUs: https://docs.pytorch.org/tutorials/prototype/pt2e_quant_xpu_inductor.html
Intel AI software resources: https://developer.intel.com/ai

About Intel Software:
Intel® Developer Zone is committed to empowering and assisting software developers in creating applications for Intel hardware and software products. The Intel Software YouTube channel is an excellent resource for those seeking to enhance their knowledge. Our channel provides the latest news, helpful tips, and engaging product demos from Intel and our numerous industry partners. Our videos cover various topics; you can explore them further by following the links.

Connect with Intel Software:
INTEL SOFTWARE WEBSITE:https://intel.ly/2KeP1hDD
INTEL SOFTWARE on FACEBOOK:http://bit.ly/2z8MPFFF
INTEL SOFTWARE on TWITTER:http://bit.ly/2zahGSnn
INTEL SOFTWARE GITHUB:http://bit.ly/2zaih6zz
INTEL DEVELOPER ZONE LINKEDIN:http://bit.ly/2z979qss
INTEL DEVELOPER ZONE INSTAGRAM:http://bit.ly/2z9Xsbyy
INTEL GAME DEV TWITCH:http://bit.ly/2BkNshuu

#intelsoftware
PyTorch Export Quantization with Intel GPUs | Intel Software




Other Videos By Intel Software


2025-06-11The Heart of HPC Today: Heterogeneous Computing | Intel Software
2025-06-10FAMU-FSU: Up-to-the-Minute Lessons in AI with the help of the Educator Program by Intel
2025-06-10Cornell University: A Support System to Optimize Curriculum, Course Materials and Student Engagement
2025-06-10Cal Poly: Breaking New Ground in Programming Curriculum, Without Reinventing the Wheel
2025-06-10RAG Pipeline Using Standard Libraries and OPEA | AI with Guy |
2025-06-09Run PyTorch 2.7 on Intel GPUs: A Step-by-Step Setup | AI with Guy
2025-06-06GPU Coding Using Triton Compiler | AI with Guy
2025-06-05vLLM Server Using OpenAI API on Gaudi 3 | AI with Guy
2025-06-04Build a Gen-AI Application Across Multiple AWS Instances with OPEA | AI with Guy
2025-06-03OPEA vs. NVIDIA NIM: What’s Best for Your GenAI Deployment?
2025-05-28PyTorch Export Quantization with Intel GPUs | Intel Software
2025-05-23Unlocking Gen AI: From Experimentation to Production with Red Hat & Intel | Intel Software
2025-05-23Overcoming Deployment Challenges: Scaling AI in Edge Computing w/ Red Hat AI & Intel Edge Platforms
2025-05-23Discover AI Innovations at Red Hat Summit with Intel: RHEL AI, OpenShift AI & Edge AI
2025-05-22Explore OpenVINO Model Hub – Instantly Compare AI Model Performance Across Devices | AI with Guy
2025-05-22Build a RAG Chatbot with OPEA on AWS | AI with Guy | Intel Software
2025-05-20Enterprise AI Inference with Intel: Bill Pearson on Infrastructure & Standards | Intel Software
2025-05-20Automatically Quantize LLMs with AutoRound | Intel Software
2025-05-13Deploy Compiled PyTorch Models on Intel GPUs with AOTInductor | Intel Software
2025-04-21Faster GenAI, Visual AI, Edge to Cloud, and HPC Solutions | oneAPI & AI Tools 2025.1
2025-04-16Run Inference with a Model from Hugging Face Hub on an Intel® Gaudi™ AI Accelerator | Intel Software