Research talk: Resource-efficient learning for large pretrained models

Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=lP0ZyHmlMS8



Duration: 7:27
80 views
0


Speaker: Subho Mukherjee, Senior Researcher, Microsoft Research Redmond

At Microsoft Research, we are approaching large-scale AI from many different perspectives, which include not only creating new, bigger models, but also developing unique ways of optimizing AI models from training to deployment. One of the main challenges posed by larger AI models is that they are more difficult to deploy in an affordable and sustainable way, and it is also still hard for them to learn new concepts and tasks effectively. Join Microsoft Researcher Subho Mukherjee for the second of three lightning talks in this series on Efficient and adaptable large-scale AI. See talks from Microsoft Researchers Yu Cheng and Guoqing Zheng to learn more about the work Microsoft is doing to improve the efficiency of computation and data in large-scale AI models.

Learn more about the 2021 Microsoft Research Summit: https://Aka.ms/researchsummit




Other Videos By Microsoft Research


2022-02-08Research talks: Research partners on innovation for carbon neutralization
2022-02-08Panel: Innovative solutions and frontier technology for carbon neutralization from different angles
2022-02-08Research talk: Nexus between climate change and energy policy: Lessons from California
2022-02-08Research talk: Sustainable energy for all and the role of innovation
2022-02-08Research talk: When climate is everything, all systems must change
2022-02-08Research talk: Getting to net zero safely
2022-02-08Keynote: Building a net-zero future together
2022-02-08Opening Remarks: Research for Carbon Negative
2022-02-08Research talk: Computationally efficient large-scale AI
2022-02-08Research talk: Towards data-efficient machine learning with meta-learning
2022-02-08Research talk: Resource-efficient learning for large pretrained models
2022-02-08Research talk: Transformer efficiency: From model compression to training acceleration
2022-02-08Plenary: Industrial Research in the 21st Century
2022-02-02Dead-end Discovery: How offline reinforcement learning could assist healthcare decision-makers
2022-01-27Microsoft Soundscape - overview of Routes feature
2022-01-24Research talk: Breaking the deadly triad with a target network
2022-01-24Research talk: Learning and pretraining strategies for dense retrieval in search and beyond
2022-01-24Opening remarks: Research for Industry
2022-01-24Opening remarks: Future of Cloud Networking
2022-01-24Research talk: Cloud networking for a post-Moore’s Law era
2022-01-24Industry talk: Key forces driving industry transformation and disruption



Tags:
deep learning
large-scale models
large-scale AI models
AI
artificial intelligence
microsoft research summit