Open Assistant Inference Backend Development (Hands-On Coding)

Channel:
Switzerland Yannic Kilcher
Subscribers:
284,000
Published on ● Video Link: https://www.youtube.com/watch?v=6OozhhI6U4g


Duration: 1:21:24
35,301 views
1,188

#ai #huggingface #coding

Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...

Original repo is here: https://github.com/huggingface/text-generation-inference

OpenAssistant repo is here: https://github.com/LAION-AI/Open-Assistant (see inference/)

Check out https://www.wandb.courses/ for free MLOps courses!

Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n



Other Videos By Yannic Kilcher


2023-05-21OpenAI suggests AI licenses (US Senate hearing on AI regulation w/ Sam Altman)
2023-05-12[ML News] Geoff Hinton leaves Google | Google has NO MOAT | OpenAI down half a billion
2023-04-27Scaling Transformer to 1M tokens and beyond with RMT (Paper Explained)
2023-04-15OpenAssistant RELEASED! The world's best open-source Chat AI!
2023-04-10AI Alignment Livestream (aka OpenAssistant "Just Chatting")
2023-04-06OpenAssistant First Models are here! (Open-Source ChatGPT)
2023-03-18The biggest week in AI (GPT-4, Office Copilot, Google PaLM, Anthropic Claude & more)
2023-03-15GPT-4 is here! What we know so far (Full Analysis)
2023-03-11This ChatGPT Skill will earn you $10B (also, AI reads your mind!) | ML News
2023-03-02LLaMA: Open and Efficient Foundation Language Models (Paper Explained)
2023-02-24Open Assistant Inference Backend Development (Hands-On Coding)
2023-02-04OpenAssistant - ChatGPT's Open Alternative (We need your help!)
2022-12-31Open Assistant Live Coding (Open-Source ChatGPT Replication)
2022-12-29AI Essay Competition (lab42)
2022-12-26Open Assistant Live Coding (Open-Source ChatGPT Replication)
2022-12-07ChatGPT: This AI has a JAILBREAK?! (Unbelievable AI Progress)
2022-11-27[ML News] GPT-4 Rumors | AI Mind Reading | Neuron Interaction Solved | AI Theorem Proving
2022-11-25CICERO: An AI agent that negotiates, persuades, and cooperates with people
2022-11-19Galactica: A Large Language Model for Science (Drama & Paper Review)
2022-11-13[ML News] Multiplayer Stable Diffusion | OpenAI needs more funding | Text-to-Video models incoming
2022-11-09The New AI Model Licenses have a Legal Loophole (OpenRAIL-M of BLOOM, Stable Diffusion, etc.)


Tags:
deep learning
machine learning
arxiv
explained
neural networks
ai
artificial intelligence
paper
open assistant
openassistant
open-assistant
chatgpt
chat gpt
open source ai
open source chatgpt
yannic coding
laion chatgpt
oa coding
rust
grpc
python
websockets
sse
server sent events