GCP for Apache Kafka Users: Stream Ingestion and Processing (Cloud Next '19)

GCP for Apache Kafka Users: Stream Ingestion and Processing (Cloud Next '19)

Channel:
United States Google Workspace
Subscribers:
1,010,000
Published on ● Video Link: https://www.youtube.com/watch?v=7H4C9q1a9No


Duration: 49:32
11,180 views
98

In private and public clouds, stream analytics commonly means stateless processing systems organized around Apache Kafka or a similar distributed log service. GCP took a somewhat different tack, with Cloud Pub/Sub, Dataflow, and BigQuery, distributing the responsibility for processing among ingestion, processing and database technologies.
We compare the two approaches to data integration and show how Dataflow allows you to join and transform and deliver data streams among on-prem and cloud Kafka clusters, Cloud Pub/Sub topics and a variety of databases. The session will have a mix of architectural discussions and practical code reviews of Dataflow-based pipelines.

Trusted Cloud Access Through Chrome Browser → https://bit.ly/2K9lfQr
Get Chrome Browser for Enterprise → https://bit.ly/2TWkABa

Watch more:
Next '19 Data Analytics Sessions here → https://bit.ly/Next19DataAnalytics
Next ‘19 All Sessions playlist → https://bit.ly/Next19AllSessions

Subscribe to the G Suite Channel → https://bit.ly/G-Suite1


Speaker(s): Ricardo Ferreira, Karthi Thyagarajan


Session ID: DA305


event: Google Cloud Next 2019; re_ty: Publish; product: Cloud - Data Analytics - BigQuery; fullname: Ricardo Ferreira, Karthi Thyagarajan;



Other Videos By Google Workspace


2019-05-07Make scheduling simple with Google Calendar in G Suite
2019-05-03Upgrading your domain to the new Hangouts Chat
2019-05-02Policy Intelligence: Applying Machine Learning and Analytics to Security in GCP (Cloud Next '19)
2019-05-02Learn about the new Hangouts Chat
2019-04-26Batch Updates with the Google Docs API
2019-04-24Empowering Global Nonprofits to Drive Impact with G Suite (Cloud Next '19)
2019-04-24Make It With G Suite: Reimagining How Businesses Work (Cloud Next '19)
2019-04-22How Wyoming is Transforming Government With G Suite (Cloud Next '19)
2019-04-19How Colgate Palmolive & Veolia enable Powerful Internal Communication with LumApps (Cloud Next '19)
2019-04-12Using Docs With the Tools You Know (Cloud Next '19)
2019-04-12GCP for Apache Kafka Users: Stream Ingestion and Processing (Cloud Next '19)
2019-04-12Avoid Unnecessary ECM Costs with Google Drive (Cloud Next '19)
2019-04-12New Workflow Features in Google Drive, Plus Airbus Case Study (Cloud Next '19)
2019-04-12How to Drive a Fully Collaborative Workplace (Cloud Next '19)
2019-04-12G Suite Data Controls and Transparency (Cloud Next '19)
2019-04-12Customer Panel: Unifying Communications With Google (Cloud Next '19)
2019-04-12Advances in Stream Analytics (Cloud Next '19)
2019-04-11Engage Employees with Currents (Cloud Next '19)
2019-04-11Modern Data Warehousing with BigQuery (Cloud Next '19)
2019-04-11How to Grow a Spreadsheet into an Application (Cloud Next '19)
2019-04-11Scaling Industrial IoT in the Upstream Energy Industry (Cloud Next '19)


Tags:
type: Conference Talk (Full production);
pr_pr: Google Cloud Next
purpose: Educate