Exploring Hugging Face Starcoder in Rust on custom AWS GPU hardware

Channel:
United States Pragmatic AI Labs
Subscribers:
17,700
Published on ● Video Link: https://www.youtube.com/watch?v=g7WGCU3YSXc


Duration: 5:54
215 views
7

Here is something I haven't seen a lot of yet, running #huggingface #starcoder on your own #aws #nvidia instance with ONE LINE OF CODE in #Rust thanks to Hugging Face #candle. Check it out....

Very possible I think to have your own coding assistant with StarCoder that only costs you the hardware.

Repo tutorial here: https://lnkd.in/gzh6vWer

Part of upcoming #duke #coursera #rust specialization. More specializations here (including rust material): https://lnkd.in/ea7QrSJF

#llmops

If you enjoyed this video, your learning journey has just begun! Dive deeper into the fascinating world of technology with these hand-picked resources:

πŸ“Š Data Visualization and Python:

Data Visualization with Python: https://www.coursera.org/learn/data-visualization-python
πŸ› οΈ DevOps, MLOps, and Cloud Computing:

DevOps, DataOps, MLOps: https://www.coursera.org/learn/devops-dataops-mlops-duke
MLOps Platforms: AWS SageMaker and Azure ML: https://www.coursera.org/learn/mlops-aws-azure-duke
Building Cloud Computing Solutions at Scale Specialization: https://www.coursera.org/specializations/building-cloud-computing-solutions-at-scale
AWS Certified Solutions Architect - Professional (SAP-C01) Cert Prep: https://www.linkedin.com/learning/aws-certified-solutions-architect-professional-sap-c01-cert-prep-1-design-for-organizational-complexity/design-for-organizational-complexity?autoplay=true

🐍 Python Essentials:

Python Essentials for MLOps: https://www.coursera.org/learn/python-essentials-mlops-duke
Python, Bash, and SQL Essentials for Data Engineering Specialization: https://www.coursera.org/specializations/python-bash-sql-data-engineering-duke

πŸ“š Must-Read Books:

Practical MLOps: https://www.amazon.com/Practical-MLOps-Operationalizing-Machine-Learning/dp/1098103017
Python for DevOps: https://www.amazon.com/gp/product/B082P97LDW/
Developing on AWS with C#: https://www.amazon.com/Developing-AWS-Comprehensive-Solutions-Platform/dp/1492095877
Pragmatic AI Labs Books: https://www.amazon.com/gp/product/B0992BN7W8

πŸŽ₯ Follow & Subscribe:

Pragmatic AI Labs YouTube Channel: https://www.youtube.com/channel/UCNDfiL0D1LUeKWAkRE1xO5Q
52 Weeks of AWS Podcast: https://52-weeks-of-cloud.simplecast.com
noahgift.com: https://noahgift.com/
Pragmatic AI Labs Website: https://paiml.com/
Your adventure in tech awaits! Dive in now, and elevate your skills to new heights. πŸš€



Other Videos By Pragmatic AI Labs


2023-09-08Getting started with Bash and Rust using AWS CodeWhisperer, VSCode, and AWS Toolkit for VSCode
2023-09-06Security Characteristics and Benefits of Microservices
2023-09-06Live Coding AI Pair Programming with XCode
2023-09-06Live Coding AWS CodeWhisperer for AWS
2023-09-0552 Weeks of AWS: AWS Security Certification-Secure Infrastructure
2023-09-04Live Coding Rust: LLMOps in Rust-Exploring Hugging Face Candle
2023-09-0452 Weeks of AWS
2023-09-04Live Coding Rust
2023-09-03Rust Polars Criterion Benchmarking
2023-08-31Pair Programming a Rust Chatbot using ChatGPT 4 and GitHub Copilot
2023-08-29Exploring Hugging Face Starcoder in Rust on custom AWS GPU hardware
2023-08-28VS Code Remote SSH Development with AWS Accelerated Compute for Rust Inference (Uses Candle from HF)
2023-08-27Using the Rust Polars DataFrame library in a CLI
2023-08-27Rust Hugging Face Candle hello world with CUDA
2023-08-26Doing Rust Inference with Candle using GitHub Codespaces .Devcontainer
2023-08-20Building Rust AWS Lambda Add Function
2023-04-29Rust for MLOps with Amazon Sagemaker
2023-04-27Using VS Code, Copilot and Codespaces to Level Up to Rust from Python
2023-04-15Rust Distroless PyTorch Computer Vision Microservice Walkthrough
2023-04-12Assimilate-Go
2023-04-11Assimilate-Zig