Could DeepSeek R1-Lite-Preview, o1-Preview, Claude Sonnet 3.5, or Gemini 1121 Work at Google? (LIVE)

Subscribers:
16,500
Published on ● Video Link: https://www.youtube.com/watch?v=aMsUpZjoYdk



Duration: 0:00
2,729 views
99


I give some premier LLMs questions and variations of questions from the book, "Are You Smart Enough to Work At Google?"

Some interesting findings from this session were that even slightly modifying the question's phrasing and the numbers used in each question could be enough to throw the models off the correct path.

I hope you find this kind of testing interesting!




Other Videos By Kyle Kabasares


2024-12-20What I Do for NASA + the Bay Area Environmental Research Institute
2024-12-16Discussing o1-Pro's Performance on the 2024 Putnam Math Competition (LIVE)
2024-12-15Sora kinda sucks...but it's HILARIOUS
2024-12-13I'm Deleting Several LLM Math/Physics Testing Videos Today
2024-12-13Follow Up to "I'm Deleting Several LLM Math/Physics Testing Videos Today"
2024-12-08Reacting to OpenAI's Sora Release and Google's Quantum Computing Breakthrough (12/9/2024)
2024-12-02PSA online angry men: Women don’t owe you anything. Thank you for coming to my TED talk.
2024-11-29Torturing LLMs on Thanksgiving with "Mathematical Physics" by Donald H. Menzel (LIVE)
2024-11-23Zettili’s quantum mechanics textbook is the #goat #physics #quantumphysics
2024-11-23Are Any of These LLMs Smart Enough for Google?
2024-11-22Could DeepSeek R1-Lite-Preview, o1-Preview, Claude Sonnet 3.5, or Gemini 1121 Work at Google? (LIVE)
2024-11-22Gemini Experimental 1121 Did ~10 Weeks of Quantum Mechanics Research in ~10 Minutes
2024-11-21I Made DeepSeek-R1-Lite-Preview and Gemini Experimental 1114 Solve This Integral
2024-11-19Artificial Intelligence + Quantum Computing = ???
2024-11-15Should I share my random late night thoughts more often? 😅 #AI #artificialintelligence #climate
2024-11-12Life 3.0 by Max Tegmark is a must read for anyone interested in AI.
2024-11-09I Used Perplexity AI Search for the First Time
2024-11-08Reflecting on OpenAI’s o1-Full, preview, and mini Models
2024-11-0711/7 marks the birthday of Marie Curie, the only one to win a Nobel Prize in Physics AND Chemistry.
2024-11-06Post #election2024 thought: Scientists, we have to start speaking truth to power more than ever.
2024-11-02OpenAI o1 FULL Was Accidentally Released Early?! Let's Test It!



Tags:
Artificial Intelligence
ChatGPT
OpenAI
Microsoft
Copilot
AI
Claude
Anthropic
Meta
o1
o1-preview
o1-mini
OpenAI o1
Generative AI
Mathematics
Putnam Exam