Expanded BigQuery Partitioning Settings

RudderStack now supports expanded partitioning options for the BigQuery warehouse destination.

Previously, RudderStack only loaded data into BigQuery using the ingestion_time column at a day-level granularity. These default settings limited many customers from running cost-efficient, fast queries for use cases that would benefit from partitioning on a different column at a different level of granularity.

With this release, you can now choose from multiple columns for partitioning and can set an hourly granularity level.

Partition column options:

• Ingestion Time
• Loaded At
• Received At
• Timestamp
• Sent At
• Original Timestamp

Granularity options:

• Hour
• Day

Updating your BigQuery configuration

You cannot edit the partition settings for existing BigQuery destinations through the dashboard. RudderStack automatically sets their partitioning type to Ingestion time partitioning with a day level granularity.

• To change your partition configuration, RudderStack recommends creating a new BigQuery destination and deprecating the old one.
• To apply partition changes to an existing destination, reach out to the RudderStack support team.

See our BigQuery destination documentation for more information on using this feature.

Questions? Contact us by email or on Slack