Atlan crawls and maps the following assets and properties from dbt Core.
Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery:
- Test status β filter dbt tests that passed, failed, or have a warning
- Alias β filter by the name of a dbt model's identifier in the dbt project
- Unique id β filter by the unique node identifier of a dbt model
- Account name β filter by dbt account name
- Project name β filter by dbt project name
- Job name β filter by dbt job name
- Package name β filter by dbt package name
- Environment name β filter by dbt environment name
- Job status β filter by dbt job status
- Last job run β filter by the last run of the dbt job
- Last job run (created at) β filter by when a job run was created
- Last job run (updated at) β filter by when a job run was completed
- Last job run (dequeued at) β filter by when the dbt job scheduler dequeued a job from the wait queue and triggered a run
- Last job run (started at) β filter by when the latest job run started after the job scheduler triggered a run
Atlan's dbt crawler also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.
Tables
Atlan maps tables from dbt Core to its Table
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
description |
description |
asset profile and overview sidebar |
config (alias) |
alias |
asset filter and properties sidebar |
stats (row_count) |
rowCount |
asset profile and filter, overview sidebar |
stats (bytes) |
sizeBytes |
asset filter and overview sidebar |
stats (last_modified) |
sourceUpdatedAt |
asset profile and properties sidebar |
Source property | Atlan dbt-specific property | Where in Atlan |
---|---|---|
project (name) |
assetDbtProjectName |
asset filter and overview sidebar |
uniqueId |
assetDbtUniqueId |
asset filter and overview sidebar |
rawSql |
dbtRawSQL |
overview sidebar |
tags |
assetDbtTags |
asset filter and overview sidebar |
packageName |
assetDbtPackageName |
asset filter and properties sidebar |
alias |
assetDbtAlias |
asset filter and properties sidebar |
description |
description |
asset profile and overview sidebar |
created_at |
sourceCreatedAt |
asset profile, overview and properties sidebar |
compiledSql |
dbtCompiledSQL |
overview sidebar |
freshness_data (criteria) |
assetDbtSourceFreshnessCriteria |
overview sidebar |
Columns
Atlan maps columns from dbt Core to its Column
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
description |
description |
asset profile and overview sidebar |
Source property | Atlan dbt-specific property | Where in Atlan |
---|---|---|
tags |
assetDbtTags |
asset filter and overview sidebar |
packageName |
assetDbtPackageName |
asset filter and properties sidebar |
description |
description |
asset profile and overview sidebar |
created_at |
sourceCreatedAt |
asset profile, overview and properties sidebar |
Nodes
Atlan maps nodes from dbt Core to its Process
asset type. Atlan derives its lineage from the Process
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
unique_id |
assetDbtUniqueId |
asset filter and overview sidebar |
rawSql |
dbtRawSQL |
overview sidebar |
compiledSql |
dbtCompiledSQL |
overview sidebar |
Models
Atlan maps models from dbt Core to its Model
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
name |
name |
asset profile and overview sidebar |
description |
description |
asset profile and overview sidebar |
executeCompletedAt |
sourceUpdatedAt |
asset profile and properties sidebar |
owner |
sourceCreatedBy |
asset profile and properties sidebar |
dynamically generated using accountId, jobId, and uniqueId | sourceURL |
overview sidebar |
Source property | Atlan dbt-specific property | Where in Atlan |
---|---|---|
alias |
assetDbtAlias |
asset filter and properties sidebar |
meta |
assetDbtMeta |
API only |
uniqueId |
assetDbtUniqueId |
asset filter and overview sidebar |
raw_sql or raw_code |
dbtRawSQL |
overview sidebar |
compiled_sql or compiled_code |
dbtCompiledSQL |
overview sidebar |
stats |
dbtStats |
API only |
config.materialized |
dbtMaterializationType |
API only |
Metrics
Atlan maps metrics from dbt Core to its Metric
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
name |
name |
asset profile and overview sidebar |
description |
description |
asset profile and overview sidebar |
executeCompletedAt |
sourceUpdatedAt |
asset profile and properties sidebar |
owner |
sourceCreatedBy |
asset profile and properties sidebar |
dynamically generated using accountId, jobId, and uniqueId | sourceURL |
overview sidebar |
Source property | Atlan dbt-specific property | Where in Atlan |
---|---|---|
alias |
assetDbtAlias |
asset filter and properties sidebar |
meta |
assetDbtMeta |
API only |
uniqueId |
assetDbtUniqueId |
asset filter and overview sidebar |
tags |
assetDbtTags |
asset filter and overview sidebar |
type |
metricType |
asset filter and overview sidebar |
sql |
metricSQL |
asset preview and overview sidebar |
timestamp |
metricTimestamp |
overview sidebar |
timeGrains |
metricTimeGrains |
asset preview and overview sidebar |
dimensions |
metricDimensions |
API only |
Sources
Atlan maps sources from dbt Core to its DbtSource
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
name |
name |
asset profile and overview sidebar |
description |
description |
asset profile and overview sidebar |
executeCompletedAt |
sourceUpdatedAt |
asset profile and properties sidebar |
owner |
sourceCreatedBy |
asset profile and properties sidebar |
dynamically generated using accountId, jobId, and uniqueId | sourceURL |
overview sidebar |
Source property | Atlan dbt-specific property | Where in Atlan |
---|---|---|
alias |
assetDbtAlias |
asset filter and properties sidebar |
meta |
assetDbtMeta |
API only |
uniqueId |
assetDbtUniqueId |
asset filter and overview sidebar |
tags |
assetDbtTags |
asset filter and overview sidebar |
criteria |
assetDbtSourceFreshnessCriteria |
overview sidebar |
stats |
dbtStats |
API only |
state |
dbtState |
API only |
Tests
run_results.json
file to crawl dbt tests. We recommend uploading the file to the same folder as the manifest.json
file.Atlan maps tests from dbt Core to its Test
asset type.
Source property | Atlan property | Where in Atlan |
---|---|---|
name |
name |
asset profile and overview sidebar |
description |
description |
asset profile and overview sidebar |
dynamically generated using accountId, jobId, and uniqueId | sourceURL |
overview sidebar |
Source property | Atlan dbt-specific property | Where in Atlan |
---|---|---|
name |
assetDbtAlias |
asset filter and properties sidebar |
meta |
assetDbtMeta |
API only |
uniqueId |
assetDbtUniqueId |
asset filter and overview sidebar |
tags |
assetDbtTags |
asset filter and overview sidebar |
status |
dbtTestStatus |
asset profile |
state |
dbtTestState |
API only |
error |
dbtTestError |
asset profile and overview sidebar |
raw_code |
dbtTestRawCode |
overview sidebar |
raw_sql |
dbtTestRawSQL |
overview sidebar |
compiled_code |
dbtTestCompiledCode |
API only |
compiled_sql |
dbtTestCompiledSQL |
API only |
language |
dbtTestLanguage |
asset profile and overview sidebar |