Meaning in the age of large language models

Channel:
United States Simons Institute for the Theory of Computing
Subscribers:
68,700
Published on ● Video Link: https://www.youtube.com/watch?v=lA19zXgObKA


Duration: 58:36
2,156 views
50

Steven Piantadosi (UC Berkeley)
https://simons.berkeley.edu/talks/steven-piantadosi-uc-berkeley-2023-08-17
Large Language Models and Transformers

The recent rise in large language models profoundly changes the landscape for theories of human language. I'll discuss how these models should cause us to rethink popular ideas about grammar and language acquisition. Maybe most importantly, modern language models provide a compelling way to think about semantics and conceptual representation. I'll argue that the sense in which they possess "meanings" is likely to be analogous to how human words and concepts achieve meaning by implementing "conceptual role" theories which are at least partially accessible in the statistics present in text, even without embodied contact with the world.



Other Videos By Simons Institute for the Theory of Computing


2023-08-19Short Talks
2023-08-19Short Talks
2023-08-19A data-centric view on reliable generalization: From ImageNet to LAION-5B
2023-08-19Pretraining Task Diversity and the Emergence of Non-Bayesian In-Context Learning for Regression
2023-08-18In-Context Learning: A Case Study of Simple Function Classes
2023-08-18Watermarking of Large Language Models
2023-08-18Human-AI Interaction in the Age of Large Language Models
2023-08-18Are LLMs the Beginning or End of NLP?
2023-08-18Beyond Language: Scaling up Robot Ontogeny
2023-08-18Integrating Language into Intelligent Architectures
2023-08-17Meaning in the age of large language models
2023-08-17Formalizing Explanations of Neural Network Behaviors
2023-08-17Are Aligned Language Models “Adversarially Aligned”?
2023-08-17Language Models as Statisticians, and as Adapted Organisms
2023-08-17On Localization in Language Models
2023-08-17Panel Discussion
2023-08-16Large Language Models Meet Copyright Law
2023-08-16How to Use Self-Play for Language Models to Improve at Solving Programming Puzzles
2023-08-16Build an Ecosystem, Not a Monolith
2023-08-16Interpretability via Symbolic Distillation
2023-08-16A Theory for Emergence of Complex Skills in Language Models


Tags:
Simons Institute
theoretical computer science
UC Berkeley
Computer Science
Theory of Computation
Theory of Computing
Large Language Models and Transformers
Steven Piantadosi