Yandex's PV-Tuning: Run Llama 70B at home! Local AI just got more accessible! 🚀🦙

Channel:

MattVidPro AI

Subscribers:

292,000

Published on October 1, 2024 3:22:39 PM ● Video Link: https://www.youtube.com/watch?v=_sqS_o9D0ag

Duration: 0:00

3,766 views

335

AI Compression just got better!

▼ Link(s) From Today’s Video:

Download the compressed models:
70B Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
70B Instruct Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16/tree/main
8B Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf
8B Instruct Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf
Learn more about PV-Tuning: https://arxiv.org/abs/2405.14852

► MattVidPro Discord: https://discord.gg/mattvidpro

► Follow Me on Twitter: https://twitter.com/MattVidPro

► Buy me a Coffee! https://buymeacoffee.com/mattvidpro
-------------------------------------------------

▼ Extra Links of Interest:

AI LINKS MASTER LIST: https://www.futurepedia.io/

General AI Playlist:    • General MattVidPro AI Playlist  

AI I use to edit videos: https://www.descript.com/?lmref=nA4fDg

Instagram: instagram.com/mattvidpro

Tiktok: tiktok.com/@mattvidpro

Second Channel:    / @matt_pie  

Let's work together!
- For brand & sponsorship inquiries: https://tally.so/r/3xdz4E
- For all other business inquiries: mattvidpro@smoothmedia.co

Thanks for watching Matt Video Productions! I make all sorts of videos here on Youtube! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!

All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.