What is Mixture of Experts?

Channel:
United States IBM Technology
Subscribers:
1,190,000
Published on ● Video Link: https://www.youtube.com/watch?v=sYDlVVyJYn4


Duration: 0:00
7,426 views
287

Want to play with the technology yourself? Explore our interactive demo → https://ibm.biz/BdK8fn
Learn more about the technology → https://ibm.biz/BdK8fe

In this video, Master Inventor Martin Keen explains the concept of Mixture of Experts (MoE), a machine learning approach that divides an AI model into separate subnetworks or experts, each focusing on a subset of the input data. Martin discusses the architecture, advantages, and challenges of MoE, including sparse layers, routing, and load balancing.

AI news moves fast. Sign up for a monthly newsletter for AI updates from IBM → https://ibm.biz/BdK8fb



Other Videos By IBM Technology


2024-09-09IBM Tech Now: IBM at the US Open and the new Telum II processor
2024-09-06NEO 1X Robot, OpenAI chips, The AI Scientist, and the future of prompt engineering
2024-09-05Preventing a Global Software Catastrophe: Disaster Recovery Strategies & Lessons Learned
2024-09-04Primary and Secondary DNS: A Complete Guide
2024-09-04How open source can democratize AI
2024-09-0310 Principles for Secure by Design: Baking Security into Your Systems
2024-09-02What is the K-Nearest Neighbor (KNN) Algorithm?
2024-08-30Cursor hype, Perplexity introduces ads, and AI at the US Open
2024-08-29The future of Art in an AI World
2024-08-29Connecting Large Language Models to Chatbots in Under 10 Minutes
2024-08-28What is Mixture of Experts?
2024-08-27How the data helps you win Fantasy Football with ESPN's Greeny
2024-08-26IBM Tech Now: Cyber Exposure Insights, NIST PQC standards and watsonx Code Assistant for Z 2.1
2024-08-26iPaaS: Your Solution to App Chaos and Integration
2024-08-24AMD acquires ZT
2024-08-23Anatomy of an AI ATTACK: MITRE ATLAS
2024-08-23Agent Q, no AI in art, and AMD acquires ZT Systems
2024-08-22Securing personally identifiable data in AI
2024-08-22Putting AI to work in FinOps
2024-08-21Large Language Model Performance
2024-08-21An AI advantage for the US Open