​LLMs in Production - A Costly Dilemma!

Channel:
Canada LLMs Explained - Aggregate Intellect - AI.SCIENCE
Subscribers:
20,400
Published on ● Video Link: https://www.youtube.com/watch?v=Hne95kH5hxk


Duration: 50:45
364 views
8

When deploying machine learning models in production, there are three properties that are commonly desired: generalization, evaluation, and cost-optimality. We conjecture that for machine learning models, it is impossible to optimize all three. I will talk about our framework for cost modeling and evaluation for large language models (LLMs) and present our LLMOps production pipeline.



Other Videos By LLMs Explained - Aggregate Intellect - AI.SCIENCE


2023-10-27LLMs, Gen AI and Stakeholder Buy-in
2023-10-19Council: A Framework for Developing Generative AI Applications
2023-10-19LLM Pitch Session - Technical Customer Experience and Effective Communication
2023-10-19LLMs for Security Compliance Assessment
2023-10-19Forecasting Systems and Disruption with Transformers
2023-10-19Startup Pitch: Automating Data Extraction with AI
2023-10-19LLM Live Book - Project Update - 2023-08-11
2023-09-05The Importance of Privacy in ChatGPT and LLMs
2023-09-05Building Ernie for Topic Modelling Using LLMs
2023-09-05The Business Impact and Challenges of Using Large Language Models
2023-07-10​LLMs in Production - A Costly Dilemma!
2023-07-10​Diving Into Document Question and Answering Systems with LLMs
2023-07-10Project Update - Building a Live Book
2023-07-10High Performance Computing on Cloud for Generative AI
2023-07-10​ThinkGPT: Agent and Chain of Thought techniques for LLMs
2023-07-10LLM Starter Pack: A Pragmatic Guide to Success with the Large Language Models
2023-07-10​PandasAI - Talk to Your Data
2023-07-10​Which Open-source LLM to Choose for Your Task?
2023-06-14Computational Thinking
2023-06-13Invest in Deep Tech like an Engineer - Deep Random Talks
2023-06-12Total Recall with NLP and LLMs - Deep Random Talks


Tags:
deep learning
machine learning