Google I/O 2011: Large-scale Data Analysis Using the App Engine Pipeline API

Channel:
United States Google for Developers
Subscribers:
2,510,000
Published on ● Video Link: https://www.youtube.com/watch?v=Rsfy_TYA2ZY


Duration: 51:39
15,057 views
55

Brett Slatkin

The Pipeline API makes it easy to analyze complex data using App Engine. This talk will cover how to build multi-phase Map Reduce workflows; how to merge multiple large data sources with "join" operations; and how to build reusable analysis components. It will also cover the API's concurrency model, how to debug in production, and built-in testing facilities.



Other Videos By Google for Developers


2011-05-13Google I/O 2011: 3D Graphics on Android: Lessons learned from Google Body
2011-05-13Google I/O 2011: Memory management for Android Apps
2011-05-13Google I/O 2011: Introducing In-App Payments for the Web
2011-05-13Google I/O 2011: GIS with Google Earth and Google Maps
2011-05-13Google I/O 2011: JavaScript Programming in the Large with Closure Tools
2011-05-13Google I/O 2011: Fireside Chat with the App Engine Team
2011-05-13Google I/O 2011: Life in App Engine Production
2011-05-13Google I/O 2011: HTML5 versus Android: Apps or Web for Mobile Development?
2011-05-13Google I/O 2011: Google Tasks API
2011-05-13Google I/O 2011: Identity and Data Access: OpenID and OAuth
2011-05-13Google I/O 2011: Large-scale Data Analysis Using the App Engine Pipeline API
2011-05-13Google I/O 2011: Building Web Apps for Google TV
2011-05-13Google I/O 2011: Compliance and Security in the Cloud
2011-05-13Google I/O 2011: Creating Accessible Interactive Web Apps using HTML5
2011-05-13Google I/O 2011: YouTube's iframe Player: The Future of Embedding
2011-05-13Google I/O 2011: Map your business, inside and out
2011-05-13Google I/O 2011: High-performance GWT: best practices for writing smaller, faster apps
2011-05-13Google I/O 2011: Life of a Google API Developer
2011-05-13Google I/O 2011: Querying Freebase: Get More From MQL
2011-05-13Google I/O 2011: Google Checkout: A Foundation For Payments
2011-05-13Google I/O 2011: The YouTube Caption API, Speech Recognition, and WebVTT captions for HTML5


Tags:
Map Reduce
Pipeline API