Research talk: Knowledgeable pre-trained language models

Channel:
Microsoft Research
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=QEjNVDvG59Q


Duration: 15:22
541 views
0

Speaker: Zhiyuan Liu, Associate Professor, Tsinghua University

Over the past years, large-scale pretrained models with billions of parameters have improved the state of the art in nearly every natural language processing (NLP) task. These models are fundamentally changing the research and development of NLP and AI in general. Recently, researchers are expanding such models beyond natural language texts to include more modalities, such as structured knowledge bases, images, and videos. With this background, the talks in this session are expected to introduce the latest advances in pretrained models, and also discuss the future of this research frontier. Hear from Zhiyuan Liu, Tsinghua University, in the third of three talks on recent advances and applications of language model pretraining.

Learn more about the 2021 Microsoft Research Summit: https://Aka.ms/researchsummit



Other Videos By Microsoft Research


2022-02-08Demo: RAI Toolbox: An open-source framework for building responsible AI
2022-02-08Opening remarks: Responsible AI
2022-02-08Closing remarks: Deep Learning and Large Scale AI
2022-02-08Roundtable discussion: Beyond language models: Knowledge, multiple modalities, and more
2022-02-08Research talk: Closing the loop in natural language interfaces to relational databases
2022-02-08Just Tech: Bringing CS, the social sciences, and communities together for societal resilience
2022-02-08Research talk: WebQA: Multihop and multimodal
2022-02-08Opening remarks: Tech for resilient communities
2022-02-08Research talk: Towards Self-Learning End-to-end Dialog Systems
2022-02-08Research talk: Focal Attention: Towards local-global interactions in vision transformers
2022-02-08Research talk: Knowledgeable pre-trained language models
2022-02-08Opening remarks: Deep Learning and Large-Scale AI
2022-02-08Closing remarks: Cloud Intelligence/AIOps
2022-02-08Research talk: Optimizing the cloud supply chain
2022-02-08Research talk: Automating and Optimizing IT Operations Management with AI
2022-02-08Research talk: An intelligent data-driven paradigm towards cloud reliability
2022-02-08Talk: Multidimensional analysis of cloud-native software based on large-scale operation data
2022-02-08Keynote: Cloud Intelligence: Infusing AI into cloud computing systems
2022-02-08Opening remarks: Cloud Intelligence/AIOps
2022-02-08Research talk: NUWA: Neural visual world creation with multimodal pretraining
2022-02-08Research talk: Large-scale, self-supervised pretraining: From language to vision


Tags:
deep learning
large-scale models
large-scale AI models
AI
artificial intelligence
microsoft research summit