Google BigQuery + Dagster#

Using Dagster's software-defined assets and BigQuery I/O manager, you can easily interact with BigQuery tables alongside other Dagster assets.

Managing your BigQuery tables with Dagster enables you to:

  • Use Python to analyze your data stored in BigQuery without writing custom SQL queries to fetch the data
  • Visualize the data dependencies between tables
  • Selectively update the contents of your tables
  • Integrate your Snowflake tables with other tools in your data stack

BigQuery and Dagster tutorial#

In this tutorial, you'll learn how to store and load Dagster's software-defined asset in BigQuery. Click here to get started.

By the end of the tutorial, you will have a connection to your BigQuery instance and a handful of assets that create tables in BigQuery or read existing tables from Snowflake.

References#