DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459
27,717Dylan Patel is the founder of SemiAnalysis, a research & analysis company specializing in semiconductors, GPUs, CPUs, and AI hardware. Nathan Lambert is a research scientist at the Allen Institute for AI (Ai2) and the author of a blog on AI called Interconnects.
Thank you for listening ❤ Check out our sponsors:https://lexfridman.com/sponsors/ep459-sbb
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:https://lexfridman.com/deepseek-dylan-patel-nathan-lambert-transcript.
CONTACT LEX:
Feedback - give feedback to Lex:https://lexfridman.com/surveyy
AMA - submit questions, videos or call-in:https://lexfridman.com/amaa
Hiring - join our team:https://lexfridman.com/hiringg
Other - other ways to get in touch:https://lexfridman.com/contactt
EPISODE LINKS:
Dylan's X:https://x.com/dylan522pp
SemiAnalysis:https://semianalysis.com//
Nathan's X:https://x.com/natolambertt
Nathan's Blog:https://www.interconnects.ai//
Nathan's Podcast:https://www.interconnects.ai/podcastt
Nathan's Website:https://www.natolambert.com//
Nathan's YouTube: / @natolambert
Nathan's Book:https://rlhfbook.com//
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Invideo AI: AI video generator.
Go tohttps://lexfridman.com/s/invideoai-ep459-sb.
GitHub: Developer platform and AI code editor.
Go tohttps://lexfridman.com/s/github-ep459-sbb
Shopify: Sell stuff online.
Go tohttps://lexfridman.com/s/shopify-ep459-sb.
NetSuite: Business management software.
Go tohttps://lexfridman.com/s/netsuite-ep459-sb.
AG1: All-in-one daily nutrition drinks.
Go tohttps://lexfridman.com/s/ag1-ep459-sbb
OUTLINE:
0:00 - Introduction
3:33 - DeepSeek-R1 and DeepSeek-V3
25:07 - Low cost of training
51:25 - DeepSeek compute cluster
58:57 - Export controls on GPUs to China
1:09:16 - AGI timeline
1:18:41 - China's manufacturing capacity
1:26:36 - Cold war with China
1:31:05 - TSMC and Taiwan
1:54:44 - Best GPUs for AI
2:09:36 - Why DeepSeek is so cheap
2:22:55 - Espionage
2:31:57 - Censorship
2:44:52 - Andrej Karpathy and magic of RL
2:55:23 - OpenAI o3-mini vs DeepSeek r1
3:14:31 - NVIDIA
3:18:58 - GPU smuggling
3:25:36 - DeepSeek training on OpenAI data
3:36:04 - AI megaclusters
4:11:26 - Who wins the race to AGI?
4:21:39 - AI agents
4:30:21 - Programming and AI
4:37:49 - Open source
4:47:01 - Stargate
4:54:30 - Future of AI
PODCAST LINKS:
Podcast Website:https://lexfridman.com/podcastt
Apple Podcasts:https://apple.co/2lwqZIrr
Spotify:https://spoti.fi/2nEwCF88
RSS:https://lexfridman.com/feed/podcast//
Podcast Playlist: • Lex Fridman Podcast
Clips Channel:
SOCIAL LINKS:
X:https://x.com/lexfridmann
Instagram:https://instagram.com/lexfridman
TikTok:https://tiktok.com/@lexfridman
LinkedIn:https://linkedin.com/in/lexfridman
Facebook:https://facebook.com/lexfridman
Patreon:https://patreon.com/lexfridman
Telegram:https://t.me/lexfridmann
Reddit:https://reddit.com/r/lexfridman