Fine-Tuning 70B Llama2 on Intel® Gaudi® 2 | Intel Software

Channel:
United States Intel Software
Subscribers:
257,000
Published on ● Video Link: https://www.youtube.com/watch?v=2av8TeBE1n0


Duration: 5:41
2,488 views
18

How to fine-tune a large language model (llama2 70B as an example) on Gaudi2 on the Intel® Developer Cloud.

Fine-Tuning Llama2-70B with DeepSpeed ZeRO-3 and Low-Rank Adaptation (LoRA) on Intel® Gaudi®2 AI Accelerator: https://intel.ly/4dEQrR7

About Intel Software:
Intel® Developer Zone is committed to empowering and assisting software developers in creating applications for Intel hardware and software products. The Intel Software YouTube channel is an excellent resource for those seeking to enhance their knowledge. Our channel provides the latest news, helpful tips, and engaging product demos from Intel and our numerous industry partners. Our videos cover various topics; you can explore them further by following the links.

Connect with Intel Software:
INTEL SOFTWARE WEBSITE: https://intel.ly/2KeP1hD
INTEL SOFTWARE on FACEBOOK: http://bit.ly/2z8MPFF
INTEL SOFTWARE on TWITTER: http://bit.ly/2zahGSn
INTEL SOFTWARE GITHUB: http://bit.ly/2zaih6z
INTEL DEVELOPER ZONE LINKEDIN: http://bit.ly/2z979qs
INTEL DEVELOPER ZONE INSTAGRAM: http://bit.ly/2z9Xsby
INTEL GAME DEV TWITCH: http://bit.ly/2BkNshu

#intelsoftware #AI

Fine-Tuning 70B Llama2 on Intel® Gaudi® 2 | Intel Software



Other Videos By Intel Software


2024-05-29Intel® Tiber™ AI Studio | Reduce Complexity, Level Up Productivity | Intel Software
2024-05-29Introducing the Intel® Tiber™ Portfolio | Intel Software
2024-05-29Ready for Exascale - Bringing Science Into the Future | Code Together Podcast | Intel Software
2024-05-28Optimized Machine Learning/Deep Learning with oneDNN | Intel Software
2024-05-28Join Us at Intel Innovation | oneAPI Dev News | Intel Software
2024-05-27Watch the May 2024 oneAPI Dev News Episode | Intel Software
2024-05-22Watch the May 2024 Episode of IDZ News! | Intel Software
2024-05-22New for May 2024 | oneAPI Dev News | Intel Software
2024-05-20AIPC, Hackathons, and Innovation | May 2024 | IDZ News | Intel Software
2024-05-20WebNN | Web Neural Networks for the AI PC | Intel Software
2024-05-19Fine-Tuning 70B Llama2 on Intel® Gaudi® 2 | Intel Software
2024-05-16End Parallel Runtime Scheduling Conflicts | Intel Software
2024-05-14MPI Multi-GPU Device Offload Debug with Intel Distribution for GDB* | Intel Software
2024-05-14Accelerate Machine Learning and Data Science with oneDAL | Intel Software
2024-05-12Debugging Just-in-Time and Ahead-of-Time Compiled GPU Code | Part 1 | Intel Software
2024-05-12Debugging Just-in-Time and Ahead-of-Time Compiled GPU Code | Part 2 | Intel Software
2024-04-30Open Innovation in Education | April 2024 | oneAPI Dev News | Intel Software
2024-04-29Get Intel® Gaudi® 2 on Intel® Developer Cloud in 2 Minutes | Intel Software
2024-04-29Discover awesome-oneapi on GitHub | April 2024 | oneAPI Dev News | Intel Software
2024-04-29Bringing AI Innovation to Africa Part 2 | Code Together Podcast | Intel Software
2024-04-28April 2024 | oneAPI Dev News | Intel Software


Tags:
Intel Developer Zone
IDZ
Intel Software
Software Developer
Developer Tools
Software Tools
Developer
Intel
AI
fine-tuning
llama2
gaudi