1. Atlan
  2. Connections
  3. dbt Connectivity

What does Atlan crawl from dbt Core?

Updated

Atlan crawls and maps the following assets and properties from dbt Core. Atlan also supports lineage between the following:

  • dbt models
  • SQL tables materialized from dbt source tables and dbt models
  • SQL tables materialized from dbt source tables and SQL tables materialized by dbt models
  • SQL tables materialized by dbt models
  • Column-lineage for all of the above

Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:

  • Test status — filter dbt tests that passed, failed, or have a warning
  • Alias — filter by the name of a dbt model's identifier in the dbt project
  • Unique id — filter by the unique node identifier of a dbt model
  • Account name — filter by dbt account name
  • Project name — filter by dbt project name, only supported for dbt Core version 1.6+
  • Job name — filter by dbt job name
  • Package name — filter by dbt package name
  • Environment name — filter by dbt environment name
  • Job status — filter by dbt job status
  • Last job run — filter by the last run of the dbt job
  • Last job run (created at) — filter by when a job run was created
  • Last job run (updated at) — filter by when a job run was completed
  • Last job run (dequeued at) — filter by when the dbt job scheduler dequeued a job from the wait queue and triggered a run
  • Last job run (started at) — filter by when the latest job run started after the job scheduler triggered a run

Atlan's dbt crawler also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.

💪 Did you know? Atlan allows you to sync your dbt tags and update your dbt assets with the synced tags. It is also possible to map other metadata on Atlan's assets through your dbt models.

Tables

Atlan maps tables from dbt Core to its Table asset type.

Source property Atlan property Where in Atlan
description description asset profile and overview sidebar
config (alias) alias asset filter and properties sidebar
stats (row_count) rowCount asset profile and filter, overview sidebar
stats (bytes) sizeBytes asset filter and overview sidebar
stats (last_modified) sourceUpdatedAt asset profile and properties sidebar
Source property Atlan dbt-specific property Where in Atlan
project (name) assetDbtProjectName asset filter and overview sidebar
uniqueId assetDbtUniqueId asset filter and overview sidebar
raw_sql or raw_code dbtRawSQL overview sidebar
tags assetDbtTags asset filter and overview sidebar
packageName assetDbtPackageName asset filter and properties sidebar
alias assetDbtAlias asset filter and properties sidebar
description description asset profile and overview sidebar
created_at sourceCreatedAt asset profile, overview and properties sidebar
compiled_sql or compiled_code dbtCompiledSQL overview sidebar
freshness_data (criteria) assetDbtSourceFreshnessCriteria overview sidebar

Columns

Atlan maps columns from dbt Core to its Column asset type.

Source property Atlan property Where in Atlan
description description asset profile and overview sidebar
Source property Atlan dbt-specific property Where in Atlan
meta assetDbtMeta API only
tags assetDbtTags asset filter and overview sidebar
packageName assetDbtPackageName asset filter and properties sidebar
description description asset profile and overview sidebar
created_at sourceCreatedAt asset profile, overview and properties sidebar

Models

Atlan maps models from dbt Core to its Model asset type.

Source property Atlan property Where in Atlan
name name asset profile and overview sidebar
description description asset profile and overview sidebar
executeCompletedAt sourceUpdatedAt asset profile and properties sidebar
owner sourceCreatedBy asset profile and properties sidebar
status dbtJobRuns.dbtModelRunStatus overview sidebar
Source property Atlan dbt-specific property Where in Atlan
alias assetDbtAlias asset filter and properties sidebar
meta assetDbtMeta API only
uniqueId assetDbtUniqueId asset filter and overview sidebar
raw_sql or raw_code dbtRawSQL overview sidebar
compiled_sql or compiled_code dbtCompiledSQL overview sidebar
stats dbtStats API only
config.materialized dbtMaterializationType API only

Sources

Atlan maps sources from dbt Core to its DbtSource asset type.

Source property Atlan property Where in Atlan
name name asset profile and overview sidebar
description description asset profile and overview sidebar
owner sourceCreatedBy asset profile and properties sidebar
Source property Atlan dbt-specific property Where in Atlan
alias assetDbtAlias asset filter and properties sidebar
meta assetDbtMeta API only
uniqueId assetDbtUniqueId asset filter and overview sidebar
tags assetDbtTags asset filter and overview sidebar
criteria assetDbtSourceFreshnessCriteria overview sidebar
stats dbtStats API only
state dbtState API only

Tests

🚨 Careful! For dbt Core, you need to upload the run_results.json file to crawl dbt tests. We recommend uploading the file to the same folder as the manifest.json file.

Atlan maps tests from dbt Core to its Test asset type.

Source property Atlan property Where in Atlan
name name asset profile and overview sidebar
description description asset profile and overview sidebar
Source property Atlan dbt-specific property Where in Atlan
name assetDbtAlias asset filter and properties sidebar
meta assetDbtMeta API only
uniqueId assetDbtUniqueId asset filter and overview sidebar
tags assetDbtTags asset filter and overview sidebar
status dbtTestStatus asset profile
state dbtTestState API only
error dbtTestError asset profile and overview sidebar
raw_code dbtTestRawCode overview sidebar
raw_sql dbtTestRawSQL overview sidebar
compiled_code dbtTestCompiledCode API only
compiled_sql dbtTestCompiledSQL API only
language dbtTestLanguage asset profile and overview sidebar

Related articles

See more
Was this article helpful?
1 out of 1 found this helpful