BIGQUERY
type: bigqueryGoogle's serverless, highly scalable data warehouse. Pay-per-query pricing makes it cost-effective for intermittent analytics.
DVT SUPPORT
read in federation models
materialize federation results
run full dbt projects against it
dvt seed --target loads here
DVT supports BigQuerybecause both dbt and Sling do: dbt drives standard materializations when it's your default target, Sling moves data in and out during federation. Connectivity for both layers is checked with dvt debug --all.
PREREQUISITES
Driver: google-cloud-bigquery — installed automatically by:
dvt sync
CONFIGURATION FIELDS
| FIELD | TYPE | REQUIRED | DEFAULT | DESCRIPTION |
|---|---|---|---|---|
| type | string | yes | — | Must be `bigquery` |
| project | string | yes | — | GCP project ID |
| dataset | string | yes | — | BigQuery dataset |
| location | string | no | US | BigQuery location (US, EU, etc.) |
| threads | integer | no | 4 | Number of parallel threads |
PROFILES.YML EXAMPLE
my_project:
target: bq_dev
outputs:
bq_dev:
type: bigquery
project: my-gcp-project
dataset: analytics
location: US
threads: 4SOURCES.YML EXAMPLE
sources:
- name: gcp_data
meta:
connection: bq_dev
database: raw_project
schema: raw_dataset
tables:
- name: events
- name: usersDBT ADAPTER FEATURES
When BigQuery is your default target, every standard dbt model runs through the official dbt adapter — all of its documented capabilities apply unchanged:
MATERIALIZATIONS
tableviewincrementalephemeralmaterialized_viewf_tablef_incrementalINCREMENTAL STRATEGIES
mergeinsert_overwritemicrobatchNOTABLE CONFIGS
- ▸partition_by
- ▸cluster_by
- ▸hours_to_expiration
- ▸labels
- ▸service-account auth
FEDERATION INCREMENTAL STRATEGIES
Strategies available when this engine is the target of a f_incremental model:
KNOWN LIMITATIONS
- ⚠Uses Application Default Credentials (ADC) — run `gcloud auth application-default login`