GPT-3 vs Human Brain

Channel:
United States Lex Fridman
Subscribers:
4,820,000
Published on ● Video Link: https://www.youtube.com/watch?v=kpiY_LemaTc


Duration: 3:32
213,246 views
11,738

GPT-3 has 175 billion parameters/synapses. Human brain has 100 trillion synapses. How much will it cost to train a language model the size of the human brain?

REFERENCES:

[1] GPT-3 paper: Language Models are Few-Shot Learners
https://arxiv.org/abs/2005.14165

[2] OpenAI's GPT-3 Language Model: A Technical Overview
https://lambdalabs.com/blog/demystifying-gpt-3/

[3] Measuring the Algorithmic Efficiency of Neural Networks
https://arxiv.org/abs/2005.04305



Other Videos By Lex Fridman


2020-08-24Math Meme Review with Grant Sanderson (3Blue1Brown)
2020-08-23Grant Sanderson: Math, Manim, Neural Networks & Teaching with 3Blue1Brown | Lex Fridman Podcast #118
2020-08-21Best hidden feature of Python | Chaining comparison operators
2020-08-20Sheldon Solomon: Death and Meaning | Lex Fridman Podcast #117
2020-08-19Lex Fridman Podcast | Now in ASCII + Name Change
2020-08-16Sara Seager: Search for Planets and Life Outside Our Solar System | Lex Fridman Podcast #116
2020-08-14Dileep George: Brain-Inspired AI | Lex Fridman Podcast #115
2020-08-112+2=5 in Java
2020-08-09Russ Tedrake: Underactuated Robotics, Control, Dynamics and Touch | Lex Fridman Podcast #114
2020-08-07Best feature of Python | List Comprehensions
2020-08-01GPT-3 vs Human Brain
2020-07-31Manolis Kellis: Human Genome and Evolutionary Dynamics | Lex Fridman Podcast #113
2020-07-29Ian Hutchinson: Nuclear Fusion, Plasma Physics, and Religion | Lex Fridman Podcast #112
2020-07-27The most controversial Python feature | Walrus operator
2020-07-26Richard Karp: Algorithms and Computational Complexity | Lex Fridman Podcast #111
2020-07-24When will the 200 billionth person be born?
2020-07-21Jitendra Malik: Computer Vision | Lex Fridman Podcast #110
2020-07-20Will Javascript Take Over the World? | Brian Kernighan and Lex Fridman
2020-07-19Neural networks learning spirals
2020-07-19C Programming Language | Brian Kernighan and Lex Fridman
2020-07-18Brian Kernighan: UNIX, C, AWK, AMPL, and Go Programming | Lex Fridman Podcast #109


Tags:
openai
neural network
deep learning
machine learning
language models
nlp
gpt 3 demo
gpt lex