Academic Keynote: Systems Support for Federated Computation, Mosharaf Chowdhury (U of Michigan)

Channel:
United States Google TechTalks
Subscribers:
348,000
Published on ● Video Link: https://www.youtube.com/watch?v=kbQ92n2y-3A


Duration: 34:59
222 views
4

A Google TechTalk, presented by Mosharaf Chowdhury, 2021/11/9
ABSTRACT: Systems Support for Federated Computation

Although theoretical federated learning research is growing exponentially, we are far from putting those theories into practice. In this talk, I will share our ventures into building practical systems for two extremities of federated learning and analytics. Sol is a cross-silo federated computation system that tackles network latency and bandwidth challenges faced by distributed computation between far-apart data sites. Oort, in contrast, is a cross-device federated learning system that enables training and testing on representative data distributions despite unpredictable device availability. Both deal with systems and network characteristics in the wild that are hard to account for in analytical models. I'll then share the challenges in systematically evaluating federated learning systems that have led to a disconnect between theoretical conclusions and performance in the wild. I'll conclude this talk by introducing FedScale, which is an extensible framework for evaluation and benchmarking in realistic settings to democratize practical federated learning for researchers and practitioners alike. All these systems are open-source and available at https://github.com/symbioticlab.

About the Speaker: Mosharaf Chowdhury, University of Michigan
Mosharaf Chowdhury is a Morris Wellman assistant professor of CSE at the University of Michigan, Ann Arbor, where he leads the SymbioticLab on application-infrastructure co-design for federated learning, resource disaggregation, and systems for AI and Big Data. In the past, Mosharaf invented coflows and was a co-creator of Apache Spark. Artifacts from his research are widely used in cloud datacenters. He has received many individual honors and awards as well as best-of-conference awards thanks to his amazing students and collaborators. He received his Ph.D. from the AMPLab at UC Berkeley in 2015.

For more information about the workshop: https://events.withgoogle.com/2021-workshop-on-federated-learning-and-analytics/#content



Other Videos By Google TechTalks


2022-02-08Federated Multi-Task Learning under a Mixture of Distributions
2022-02-08Private Multi-Group Aggregation
2022-02-08Private Goodness-of-Fit: A Few Ideas Go a Long Way
2022-02-08Privacy Amplification by Decentralization
2022-02-08Experimenting w/ Local & Central Differential Privacy for Both Robustness & Privacy in Fed.Learning
2022-02-08Differentially Private Fine-tuning of Language Models
2022-02-08When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning?
2022-02-08FedVault: Efficient Gradient Outlier Detection for Byzantine-Resilient and Privacy-Preserving FedML
2022-02-08Federated Learning and Analytics Research Using TensorFlow Federated
2022-02-08Day 2 Lightning Talks: Federated Optimization and Analytics
2022-02-08Academic Keynote: Systems Support for Federated Computation, Mosharaf Chowdhury (U of Michigan)
2022-02-08Day 2 Lightning Talks: Privacy & Security
2022-02-08Google Keynote: Federated Learning & Federated Analytics-Research, Applications, & System Challenges
2022-02-08Academic Keynote: Differentially Private Covariance-Adaptive Mean Estimation, Adam Smith (BU)
2022-02-08Academic Keynote: Mean Estimation with User-level Privacy under Data Heterogeneity, Rachel Cummings
2022-02-08Day 1 Lightning Talks: Federated Optimization and Analytics
2022-02-08Day 1 Lightning Talks: Privacy & Security
2022-02-08Academic Keynote: Federated Learning with Strange Gradients, Martin Jaggi (EPFL)
2022-02-08Google Keynote: Federated Aggregation and Privacy
2022-02-08Welcome and Opening Remarks
2022-01-25Warehouse-Scale Video Acceleration: Co-Design and Deployment in the Wild