RailsConf 2017: Processing Streaming Data at a Large Scale with Kafka by Thijs Cadier

Channel:
Subscribers:
42,400
Published on ● Video Link: https://www.youtube.com/watch?v=-NMDqqW1uCE



Duration: 31:37
1,996 views
30


RailsConf 2017: Processing Streaming Data at a Large Scale with Kafka by Thijs Cadier

Using a standard Rails stack is great, but when you want to process streams of data at a large scale you'll hit the stack's limitations. What if you want to build an analytics system on a global scale and want to stay within the Ruby world you know and love?

In this talk we'll see how we can leverage Kafka to build and painlessly scale an analytics pipeline. We'll talk about Kafka's unique properties that make this possible, and we'll go through a full demo application step by step. At the end of the talk you'll have a good idea of when and how to get started with Kafka yourself.




Other Videos By Confreaks


2017-05-16RailsConf 2017: Keynote by Marco Rogers
2017-05-16RailsConf 2017: Inventing Friends: ActionCable + AVS = 3 by Jonan Scheffler & Julian Cheal
2017-05-16RailsConf 2017: Whose turn is it anyway? Augmented reality board games. by Dave Tapley
2017-05-16RailsConf 2017: Goldilocks And The Three Code Reviews by Vaidehi Joshi
2017-05-16RailsConf 2017: Accessibility (when you don't have time to read the manual) by Katie Walsh
2017-05-16RailsConf 2017: Predicting Titanic Survivors with Machine Learning by Ju Liu
2017-05-16RailsConf 2017: Is it Food? An Introduction to Machine Learning by Matthew Mongeau
2017-05-16RailsConf 2017: Bayes is BAE by Richard Schneeman
2017-05-15RailsConf 2017: Panel: Performance... performance
2017-05-15RailsConf 2017: High Performance Political Revolutions by Braulio Carreno
2017-05-15RailsConf 2017: Processing Streaming Data at a Large Scale with Kafka by Thijs Cadier
2017-05-15RailsConf 2017: Panel: Ruby's Killer Feature: The Community
2017-05-15RailsConf 2017: Panel: Becoming an engineering leader
2017-05-15RailsConf 2017: It's Dangerous to go Alone: Building Teams like an Organizer by Colin Fleming
2017-05-15RailsConf 2017: Supporting Mental Health as an Effective Leader by Jesse James
2017-05-12RailsConf 2017: Bebop to the Top - The Jazz Band As A Guide To Leadership by Michael Cain
2017-05-12RailsConf 2017: Leading When You're Not in Charge by Scott Lesser
2017-05-12RailsConf 2017: We've Always Been Here: Women Changemakers in Tech by Hilary Stohs-Krause
2017-05-12RailsConf 2017: Panel: Better Hiring Practices for Fun and Profit
2017-05-12RailsConf 2017: To Code Is Human by Don Werve
2017-05-12RailsConf 2017: Understanding ‘Spoon Theory’ and Preventing Burnout by Jameson Hampton