Fine-Tuning 70B Llama2 on Intel® Gaudi® 2 | Intel Software

Channel:
United States Intel Software
Subscribers:
208,000
Published on ● Video Link: https://www.youtube.com/watch?v=2av8TeBE1n0


Duration: 5:41
2,204 views
15

How to fine-tune a large language model (llama2 70B as an example) on Gaudi2 on the Intel® Developer Cloud.

Fine-Tuning Llama2-70B with DeepSpeed ZeRO-3 and Low-Rank Adaptation (LoRA) on Intel® Gaudi®2 AI Accelerator: https://intel.ly/4dEQrR7

About Intel Software:
Intel® Developer Zone is committed to empowering and assisting software developers in creating applications for Intel hardware and software products. The Intel Software YouTube channel is an excellent resource for those seeking to enhance their knowledge. Our channel provides the latest news, helpful tips, and engaging product demos from Intel and our numerous industry partners. Our videos cover various topics; you can explore them further by following the links.

Connect with Intel Software:
INTEL SOFTWARE WEBSITE: https://intel.ly/2KeP1hD
INTEL SOFTWARE on FACEBOOK: http://bit.ly/2z8MPFF
INTEL SOFTWARE on TWITTER: http://bit.ly/2zahGSn
INTEL SOFTWARE GITHUB: http://bit.ly/2zaih6z
INTEL DEVELOPER ZONE LINKEDIN: http://bit.ly/2z979qs
INTEL DEVELOPER ZONE INSTAGRAM: http://bit.ly/2z9Xsby
INTEL GAME DEV TWITCH: http://bit.ly/2BkNshu

#intelsoftware #AI

Fine-Tuning 70B Llama2 on Intel® Gaudi® 2 | Intel Software



Other Videos By Intel Software


2024-06-05New Generative-AI (InstantID) Using OpenVINO™ Toolkit | Intel Software
2024-06-04Build, Test, and Deploy AI Solutions Faster with Intel® Tiber™ Developer Cloud | Intel Software
2024-05-31Parallelize pandas with Modin* | Intel Software
2024-05-30Introducing the Intel® Tiber™ Portfolio | Intel Software
2024-05-29Join Us at Intel Innovation | oneAPI Dev News | Intel Software
2024-05-28Watch the May 2024 oneAPI Dev News Episode | Intel Software
2024-05-23New for May 2024 | oneAPI Dev News | Intel Software
2024-05-23Watch the May 2024 Episode of IDZ News! | Intel Software
2024-05-21WebNN | Web Neural Networks for the AI PC | Intel Software
2024-05-21AIPC, Hackathons, and Innovation | May 2024 | IDZ News | Intel Software
2024-05-20Fine-Tuning 70B Llama2 on Intel® Gaudi® 2 | Intel Software
2024-05-17End Parallel Runtime Scheduling Conflicts | Intel Software
2024-05-15Accelerate Machine Learning and Data Science with oneDAL | Intel Software
2024-05-15MPI Multi-GPU Device Offload Debug with Intel Distribution for GDB* | Intel Software
2024-05-13Debugging Just-in-Time and Ahead-of-Time Compiled GPU Code | Part 2 | Intel Software
2024-05-13Debugging Just-in-Time and Ahead-of-Time Compiled GPU Code | Part 1 | Intel Software
2024-05-01Open Innovation in Education | April 2024 | oneAPI Dev News | Intel Software
2024-04-30Get Intel® Gaudi® 2 on Intel® Developer Cloud in 2 Minutes | Intel Software
2024-04-30Bringing AI Innovation to Africa Part 2 | Code Together Podcast | Intel Software
2024-04-30Discover awesome-oneapi on GitHub | April 2024 | oneAPI Dev News | Intel Software
2024-04-29April 2024 | oneAPI Dev News | Intel Software


Tags:
Intel Developer Zone
IDZ
Intel Software
Software Developer
Developer Tools
Software Tools
Developer
Intel
AI
fine-tuning
llama2
gaudi