Data Analytics Deep Dives - Dataplex Explore
Channel:
Subscribers:
275,000
Published on ● Video Link: https://www.youtube.com/watch?v=l_UKjNIR_eg
Provides an overview of Dataplex Explore for executing some Spark SQL against BigQuery internal tables, external tables and Hive tables. The demo also shows how you can use a notebook along with scheduling and sharing your artifacts. Everything is provisioned via an Airflow DAG using Terraform to setup the data lakes, Dataproc Metastore and the Dataplex environment so you can create your own queries.
All code is on GitHub: https://goo.gle/dagd