UPDATED: CPU Vicuna | POWERFUL Local ChatGPT 🤯 Mindblowing Unrestricted GPT-4

Channel:

TroubleChute

Subscribers:

279,000

Published on April 11, 2023 1:05:41 AM ● Video Link: https://www.youtube.com/watch?v=d4dk_7FptXk

Category:

Vlog

Duration: 8:30

32,885 views

1,319

Vicuna has "90%* quality of OpenAI ChatGPT and Google Bard" while being uncensored, locally hosted and FAST (depending on hardware). This video shows my updated install script that should make life easy AND WORKS WITH CPU!

Install Oobabooga & Vicuna (UPDATED): iex (irm vicuna.tc.ht)

View what this script does & see the source code here: https://vicuna.tc.ht

More info on Vicuna: https://vicuna.lmsys.org/
Oobabooga: https://github.com/oobabooga/text-generation-webui/

Previous video showing other features: https://youtu.be/ByV5w1ES38A

Downloading the models manually?
CPU: https://huggingface.co/eachadea/ggml-vicuna-13b-4bit/tree/main -- All files go into models\eachadea_ggml-vicuna-13b-4bit

GPU: https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g/tree/main -- All files go into "models\anon8231489123_vicuna-13b-GPTQ-4bit-128g"

Timestamps:
0:00 - Explanation
0:45 - Why this is unique
1:20 - Starting Vicuna & Oobabooga install
2:00 - Installing CPU-only Vicuna & Oobabooga (NEW)
3:00 - Vicuna CPU Desktop Shortcut (NEW)
3:45 - Using Vicuna & Oobabooga in CPU mode (NEW)
4:40 - GPU vs CPU-only install
5:38 - Installing Vicuna & Oobabooga for GPU & CPU
6:00 - Downloading GPU and/or CPU Vicuna model
7:07 - GPU vs CPU Vicuna speed

#Vicuna #AI #LLAMA
-----------------------------
💸 Found this useful? Help me make more! Support me by becoming a member: https://youtube.com/channel/UCkih2oVTbXPEpVwE-U7kmHw/join
-----------------------------
💸 Direct donations via Ko-Fi: https://ko-fi.com/TCNOco
💬 Discuss the video & Suggest (Discord): https://s.tcno.co/Discord
👉 Game guides & Simple tips: https://YouTube.com/TroubleChuteBasics
🌐 Website: https://tcno.co
📧 Need voiceovers done? Business query? Contact my business email: TroubleChute (at) tcno.co
-----------------------------
🎨 My Themes & Windows Skins: https://hub.tcno.co/faq/my-windows/
👨‍💻 Software I use: https://hub.tcno.co/faq/my-software/
➡️ My Setup: https://hub.tcno.co/faq/my-hardware/
🖥️ My Current Hardware:
Intel i9-13900k - https://amzn.to/42xQuI1
GIGABYTE Z790 AORUS Master - https://amzn.to/3nHuBHx
G.Skill RipJaws 2x(2x32G) [128GB] - https://amzn.to/42cilxN
Corsair H150i 360mm AIO - https://amzn.to/42cznvP
MSI 3080Ti Gaming X Trio - https://amzn.to/3pdnLdb
Corsair 1000W RM1000i - https://amzn.to/42gOTGY
Corsair MP600 PRO XT 2TB - https://amzn.to/3NSvwzx
🎙️ My Current Mic/Recording Gear:
Shure SM7B - https://amzn.to/3nDGYo1
Audient iD14 - https://amzn.to/3pgf2XK
dbx 286s - https://amzn.to/3VNaq7O
Triton Audio FetHead - https://amzn.to/3pdjIgZ

Everything in this video is my personal opinion and experience and should not be considered professional advice. Always do your own research and ensure what you're doing is safe.