PNWS 2014 - Apache Spark I: From Scala Collections to Fast Interactive Big Data with Spark

Channel:
United States Confreaks
Subscribers:
42,400
Published on ● Video Link: https://www.youtube.com/watch?v=3RnBuyea5Cs


Duration: 42:09
1,049 views
2

By, Evan Chan
This session introduces you to Spark by starting with something basic: Scala collections and functional data transforms. We then look at how Spark expands the functional collection concept to enable massively distributed, fast computations. The second half of the talk is for those of you who want to know the secrets to make Spark really fly for querying tabular datasets. We will dive into row vs columnar datastores and the facilities that Spark has for enabling interactive data analysis, including Spark SQL and the in-memory columnar cache. Learn why Scala's functional collections are the best foundation for working with data!

Help us caption & translate this video!

http://amara.org/v/FnIU/



Other Videos By Confreaks


2014-12-15PNWS 2014 - Composing Project Archetypes with SBT AutoPlugins
2014-12-15PNWS 2014 - Building a Better Future: Advanced Error Handling for Concurrent Programming with Scalaz
2014-12-15PNWS 2014 - Unruly Creatures: Strategies for dealing with Real Numbers
2014-12-15PNWS 2014 - Hands-on Scala.js
2014-12-15PNWS 2014 - One Year of Akka
2014-12-15PNWS 2014 - What's new since Programming in Scala
2014-12-15PNWS 2014 - Adding Tree and Tree: Distributed Decision Tree Learning
2014-12-15PNWS 2014 - The First Hit is Always Free: A Skeptic's Look at scalaz' Gateway Drugs
2014-12-12PNWS 2014 - Miniboxing: JVM Generics without the overhead
2014-12-12PNWS 2014 - Apache Spark II: Streaming Big Data Analytics with Team Apache, Scala & Akka
2014-12-12PNWS 2014 - Apache Spark I: From Scala Collections to Fast Interactive Big Data with Spark
2014-12-12PNWS 2014 - Don’t cross the streams
2014-12-12PNWS 2014- Types out of patmat
2014-12-08Keep Ruby Weird 2014 - Ten Years of Ruby Conferences: A Dramatic Revue
2014-12-05Keep Ruby Weird 2014 - Opening Keynote
2014-12-05Keep Ruby Weird 2014 - Ten Years of Ruby Conferences: A Dramatic Revue
2014-12-05RubyConf 2014 - Chat Robots Next Level Tooling by Ole Michaelis
2014-12-05RubyConf 2014 - Roda: The Routing Tree Web Framework by Jeremy Evans
2014-12-05RubyConf 2014 - Build the Unified Logging Layer with Fluentd and Ruby by Kiyoto Tamura
2014-12-05RubyConf 2014 - Easy rewrites with ruby and science! by Jesse Toth
2014-12-05RubyConf 2014 - It's so quiet. Let's make music. by Loren Segal