Possible Impossibilities and Impossible Possibilities

Channel:
United States Simons Institute for the Theory of Computing
Subscribers:
68,700
Published on ● Video Link: https://www.youtube.com/watch?v=P7ZdUbSAujQ


Duration: 1:05:45
7,301 views
141

Yejin Choi (University of Washington)
https://simons.berkeley.edu/talks/yejin-choi-university-washington-2023-08-14
Large Language Models and Transformers

In this talk, I will question if there can be possible impossibilities of large language models (i.e., the fundamental limits of transformers, if any) and the impossible possibilities of language models (i.e., seemingly impossible alternative paths beyond scale, if at all).



Other Videos By Simons Institute for the Theory of Computing


2023-08-16Large Language Models Meet Copyright Law
2023-08-16How to Use Self-Play for Language Models to Improve at Solving Programming Puzzles
2023-08-16Build an Ecosystem, Not a Monolith
2023-08-16Interpretability via Symbolic Distillation
2023-08-16A Theory for Emergence of Complex Skills in Language Models
2023-08-16Scaling Data-Constrained Language Models
2023-08-15Understanding the Origins and Taxonomy of Neural Scaling Laws
2023-08-15Panel Discussion
2023-08-14An observation on Generalization
2023-08-14Towards Reliable Use of Large Language Models: Better Detection, Consistency, and Instruction-Tuning
2023-08-14Possible Impossibilities and Impossible Possibilities
2023-08-14Sparks of Artificial General Intelligence
2023-08-10Generating Approximate Ground States of Molecules Using Quantum Machine Learning
2023-08-10Quantum-Classical Cross-Correlations and the Post-selection Problem
2023-08-10Industry Applications of Hamiltonian Simulation and Beyond
2023-08-10What Can I Do With a Noisy Quantum Computer?
2023-08-10Quantum Machine Learning in the NISQ Era
2023-07-29Structure Of Boolean Almost Low Degree Functions On The Biased Cube
2023-07-29Correspondence Colouring of Random Graphs
2023-07-28Structures in Random Graphs: New Connections
2023-07-28Noncommutativity and Rounding Schemes for Combinatorial Optimization Parts 1 & 2


Tags:
Simons Institute
theoretical computer science
UC Berkeley
Computer Science
Theory of Computation
Theory of Computing
Large Language Models and Transformers
Yejin Choi