Run your own ChatGPT at HOME!
81Wouldn’t it just be so cool to run your own copy of a chat AI like ChatGPT at home? No interference, no data leaks, no privacy concerns. Sounds great doesn’t it? Well it turns out you can, and it’s ridiculously easy! Much to my surprise too, you don’t even need a 4090 - although it would help. I’ve been running this on a 2080Ti, but really anything with 11GB or more of VRAM should just about scrape by. The more VRAM (and compute power), the better though! In theory you can also run this on your CPU alone if you have enough system memory, or on an AMD card too, but that’s a lot less stable thanks to just how ‘bleeding edge’ these tools are so your mileage may vary.
Text Generation WebGUI: https://github.com/oobabooga/text-generation-webui
HuggingFace Vicuna 13b model: https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g/tree/main
BUY AN OSRTT (Open Source Response Time Tool): https://osrtt.com
Become a Youtube Member and get sponsor free videos and access to our private Discord chat: https://www.youtube.com/techteamgb/join
Locally Links - Global Short Linking for Creators: https://locally.link/techteamgb
Use referral code "techteamgb20" when signing up!
Patreon: https://www.patreon.com/techteamgb
Donations: https://streamlabs.com/techteamgb
OverclockersUK Affiliate link: http://techteamgb.co.uk/ocuk
Discord! https://discord.gg/NxFzaWy
As an Amazon Associate I earn from qualifying purchases, using the links below or other Amazon affiliate links here.
Want a cool T-Shirt or hoodie? https://teespring.com/en-GB/stores/techteamgb
Private Internet Access (VPN): http://techteamgb.co.uk/PIA
NordVPN: https://nordvpn.org/techteamgb
HUMBLE BUNDLE: https://www.humblebundle.com/monthly?partner=techteamgb
Zen Internet - My (UK) ISP: https://locally.link/b3DC
WEB HOSTING: http://techteamgb.co.uk/domaincom
Check out our awesome website! http://techteamgb.co.uk
Bitcoin donations: 1PqsJeJsDbNEECjCKbQ2DsQxJWYqmTvt4E
- My PC - AMAZON AFFILIATE LINKS -
5900X on Amazon: https://techteamgb.co.uk/5900x
32GB Corsair 3000MHz on Amazon: https://techteamgb.co.uk/cors32gbrgb
GBT X570 Master on Amazon: https://techteamgb.co.uk/gbtx570master
RTX 2080 on Amazon: https://techteamgb.co.uk/RTX2080
H100i Pro on Amazon: https://techteamgb.co.uk/h100ipro
WD 1TB NVME on Amazon: https://techteamgb.co.uk/wdbl1tb
Patriot VP4100 on Amazon: https://techteamgb.co.uk/vp4100
Sabrent Rocket Q 4TB on Amazon: https://techteamgb.co.uk/rocketq4
If you are interested in contacting us, then please email: inbox@techteamgb.com and we will respond as soon as possible.