Expanded BigQuery Partitioning Settings

Write more performant, cost-effective queries on RudderStack event tables through advanced partitioning settings.

  •   less than a minute  

RudderStack now supports expanded partitioning options for the BigQuery warehouse destination.

Previously, RudderStack only loaded data into BigQuery using the ingestion_time column at a day-level granularity. These default settings limited many customers from running cost-efficient, fast queries for use cases that would benefit from partitioning on a different column at a different level of granularity.

With this release, you can now choose from multiple columns for partitioning and can set an hourly granularity level.

The available partition column options:

  • Ingestion Time
  • Loaded At
  • Received At (time at which RudderStack received the data)

The available granularities:

  • Hour
  • Day

See our BigQuery destination documentation for more information on using this feature.

Questions? Contact us by email or on Slack