First Look - Running a LLM (Large Language Model) on a single GPU : GPT ME? text-generation-webui

Channel:
United States Frank The Tank
Subscribers:
4,690
Published on ● Video Link: https://www.youtube.com/watch?v=KDXlxfOXiX8


Duration: 8:01
6,268 views
203

Hey Everyone! While this isn't exactly a tutorial, you should be able to get everything you need here to see the current state of homebrew LLM stuff via the text-generation-webui project by oobabooga. Make sure to check out the links!

00:00 Intro
00:40 Explaining the WebUI and Install
01:30 What does it do?
02:30 8-bit mode & windows
03:00 Demo
04:00 Building a character for chat
05:10 Downloading Models
06:00 vs NovelAI
06:45 Tankbot!

https://linktr.ee/FrankTankGaming
https://github.com/oobabooga/text-generation-webui
https://github.com/oobabooga/text-generation-webui/wiki/System-requirements
https://github.com/oobabooga/text-generation-webui/wiki/Low-VRAM-guide
https://github.com/oobabooga/text-generation-webui/wiki/Pygmalion-chat-model-FAQ
https://oobabooga.github.io/character-creator.html
https://zoltanai.github.io/character-editor/
https://github.com/DeXtmL/bitsandbytes-win-prebuilt
https://www.reddit.com/r/PygmalionAI/comments/1115gom/running_pygmalion_6b_with_8gb_of_vram/
https://github.com/oobabooga/text-generation-webui/issues/20#issuecomment-1411650652



Other Videos By Frank The Tank


2023-03-29Pause AI Experiments: An Open Letter - AI News
2023-03-28TankTok ep 2 - #ai #aiart #tiktok #tiktokvideo
2023-03-27TankTok #ai #tiktok #tiktokvideo
2023-03-25AI Dancing Girl - #ai #aiart
2023-03-24AI News, Drama, and Updates - Bard, Adobe Firefly, and Nvidia CEO maybe immortal? - 3/24/23
2023-03-21ChatGPT programming - the future #gpt4 #chatgpt
2023-03-21EASY Text to Video in Stable Diffusion with Automatic1111 WebUI
2023-03-20Using ChatGPT & GPT 4 to Create, Innovate and Inspire
2023-03-17AI News, Drama, and Updates - GPT4 Takes center-stage - 3/17/23
2023-03-10AI News, Drama, and Updates - MARCH of the BOTS - 3/10/23
2023-03-08First Look - Running a LLM (Large Language Model) on a single GPU : GPT ME? text-generation-webui
2023-03-04Textual Inversion Tutorial - Embeddings and Hypernetwork basics and walkthrough
2023-03-03AI News, Drama, and Updates - 3/3/23 - Rise of the chat bots
2023-02-24A.I. News, Drama, and Updates - 2/24/23 - Bing gets Lobotomized, China keeps pace
2023-02-17A.I. News, Drama, and Updates - 2/17/23 - That New Bing Sass
2023-02-10AI News, Drama, and Updates - 2/10/23 - Rise of the ChatBots
2023-02-03A.I. News, Drama, and Updates - 2/3/23 - Who owns how a thing can look?
2023-01-27AI News, Drama, and Updates - 1/27/23 - ChatGPT and the future
2023-01-20AI News, Drama and Updates - The future of ChatGPT, more AI lawsuits.
2023-01-11AI News, Drama, and Updates: AI Sound and my own anti-trust of Microsoft
2023-01-10AI News and Updates - Sentient Robots and The End Of Art


Tags:
text-generation-webui
oobabooga
stable diffusion
ai
artificial intelligence
replika ai
replika
chatgpt
chat bot
homebrew llm
large language model
Pygmalion
GPT-J 6B
*-Erebus
llama
RWKV
NovelAI
leak
gradio
GALACTICA
TavernAI
GPT-4chan