Fast Averaging, and Applications to MapReduce and Consensus on Graphs

Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=O_vdYQAn2xQ



Duration: 45:45
73 views
0


We look at the problem of computing the average (arithmetic mean) of a long vector of n numbers. Mathematically, this problem is simple; requires n - 1 additions and 1 division. However, some saving in the number of computations is possible if the vector exhibits certain regularity. In the extreme case, if all the numbers in the vector are equal to 5 (say), then we can get the exact answer with O(1) computations. This simple problem of finding the arithmetic mean is interesting in many applications, one of them being MapReduce-type computations. MapReduce is an architecture patented by Google, and is de facto standard for large-scale computations in today's data centers. In this talk, we present a mathematical abstraction of MapReduce, and investigate it from the following points of view: 1. Can we use a randomized algorithm to provide probabilistic performance guarantees, while speeding-up the overall completion time of a query? 2. What is the effect of 'regularity' of the underlying vector on the query completion times? This idea of approximate mean computation - that is, gaining speed-up while settling for probabilistic performance guarantees - finds applications in a number of other fields including control, robotics, estimation, and so on. We will discuss its applications to consensus on graphs. Joint work with Devavrat Shah.




Other Videos By Microsoft Research


2016-08-16Efficient Non-Interactive Secure Computation
2016-08-16Tutorial on Domain Adaptation
2016-08-16Strong LP Formulations and Primal-Dual Approximation Algorithms
2016-08-16Avatar-Facilitated Therapy and Virtual Worlds: Next-Generation Tools for Physical Rehabilitation
2016-08-16Signal Processing in Physical Environments: Crossing the Barrier of Traditional Assumptions
2016-08-16Towards Intelligent Tutoring with Mathematical Sketching
2016-08-16Play with Data: Game Visualization and Analytics
2016-08-16LATAM 2011: Water from the Mountains, the Fourth Paradigm, and the Color of Snow
2016-08-16Structured Prediction with Indirect Supervision
2016-08-16Fences and Stability in Weak Memory Models
2016-08-16Fast Averaging, and Applications to MapReduce and Consensus on Graphs
2016-08-16LATAM 2011: Keynote Pesentation - Open Science, Open Data, and Open Source
2016-08-16Law and the GeoWeb
2016-08-16LATAM 2011: Future Trends in Software Engineering
2016-08-16LATAM 2011: Keynote - Addressing Societal Challenges Through Innovation and Partnerships
2016-08-16LATAM 2011: The Microsoft Biology Foundation
2016-08-16Designing for Remixing: Computer-supported Social Creativity
2016-08-16LATAM 2011: Cloud Computing for Science in Europe and VENUS-C and Towards Exaflop Supercomputers
2016-08-16LATAM 2011: LACCIR Projects
2016-08-16LATAM 2011: Audio and Video Research for Kinect
2016-08-16Analyzing Large-Scale Object-Oriented Software to Find, Remove, and Prevent Runtime Bloat



Tags:
microsoft research