ChatGPT Directly in the Browser with WebGPU?! (No Install, No Server)

Channel:

Dustin Brett

Subscribers:

13,800

Published on April 24, 2023 7:01:25 AM ● Video Link: https://www.youtube.com/watch?v=-VsN9_oe8R0

Duration: 13:51

2,248 views

101

In this video I demo a new feature on my website which runs a local client side large language model like ChatGPT! This demo is powered by WebGPU, WebAssembly & Web Workers. The specific model being used is called Vicuna 7B and it was trained on ShareGPT data.

- Site: https://dustinbrett.com/
- Code: https://github.com/DustinBrett/daedalOS
- WebGPU: https://developer.chrome.com/blog/webgpu-release/
- WebLLM: https://mlc.ai/web-llm/
- Vicuna: https://vicuna.lmsys.org/

0:00 LLM's in the Browser!
0:30 My Website
0:45 WebGPU in Chrome 113
1:30 Web LLM
3:45 Vicuna & ShareGPT
4:55 Write a Python Script
9:48 Pretend to be a Linux Terminal
13:18 Thanks for Checking out my Video!