Evaluating MapReduce for Multi-core and Multiprocessor...

Channel:

Google TechTalks

Subscribers:

348,000

Published on October 9, 2007 2:19:39 AM ● Video Link: https://www.youtube.com/watch?v=UWUbRXO3T5I

Duration: 44:48

7,062 views

9

Google Video tech Talks
February 27, 2007

ABSTRACT

This paper evaluates the suitability of the MapReduce model for multi-core and multi-processor systems. MapReduce was created by Google for application development on data-centers with thousands of servers. It allows programmers to write functional-style code that is automatically parallelized and scheduled in a distributed system.

We describe Phoenix, an implementation of MapReduce for shared-memory systems that includes a programming API and an efficient runtime system. The Phoenix runtime automatically manages thread creation, dynamic task scheduling, data partitioning, and fault tolerance across processor nodes. We study Phoenix with...