← All Adapters

DATABRICKS

type: databricks

Unified analytics platform combining data engineering, data science, and business analytics on a lakehouse architecture.

PREREQUISITES

Driver: databricks-sql-connector — installed automatically by:

dvt sync

CONFIGURATION FIELDS

FIELDTYPEREQUIREDDEFAULTDESCRIPTION
typestringyesMust be `databricks`
hoststringyesWorkspace URL (adb-xxx.azuredatabricks.net)
http_pathstringyesSQL warehouse HTTP path (/sql/1.0/warehouses/abc)
tokenstringyesPersonal access token
catalogstringnoUnity Catalog name
schemastringnodefaultDefault schema
threadsintegerno4Number of parallel threads

PROFILES.YML EXAMPLE

my_project:
  target: dbx_dev
  outputs:
    dbx_dev:
      type: databricks
      host: adb-123456.azuredatabricks.net
      http_path: /sql/1.0/warehouses/abc123
      token: "{{ env_var('DBX_TOKEN') }}"
      schema: default

SOURCES.YML EXAMPLE

sources:
  - name: lakehouse
    connection: dbx_dev
    schema: bronze
    tables:
      - name: raw_events
      - name: raw_users

INCREMENTAL STRATEGIES

Append Delete+Insert Merge