What does Atlan crawl from dbt Core?

Have more questions? Submit a request

Atlan crawls and maps the following assets and properties from dbt Core.

Once you've crawled dbt, you can use dbt-specific filters for quick asset discovery. For example, you can use the Test status filter to find dbt tests that passed, failed, or have a warning.

Atlan's dbt crawler also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.

πŸ’ͺ Did you know? Atlan allows you to sync your dbt tags and update your dbt assets with the synced tags. It is also possible to map other metadata on Atlan's assets through your dbt models.

Tables

Atlan maps tables from dbt Core to its Table asset type.

Source property Atlan property
description description
config (alias) alias
stats (row_count) rowCount
stats (bytes) sizeBytes
stats (last_modified) sourceUpdatedAt
Source property Atlan dbt-specific property
project (name) Project Name
uniqueId Unique Identifier
rawSql Raw SQL
resourceType Resource Type
tags Tags
config (materialized) Materialisation Type
config (full_refresh) Full Refresh
config (query_tag) Query Tag
config (unique_key) Unique Key
packageName Package Name
path Path
alias Alias
description Description
created_at Created At
compiledSql Compiled SQL
freshness_data (criteria) Freshness Criteria

Columns

Atlan maps columns from dbt Core to its Column asset type.

Source property Atlan property
description description
Source property Atlan dbt-specific property
tags Tags
config (query_tag) Query Tag
packageName Package Name
path Path
description Description
created_at Created At

Nodes

Atlan maps nodes from dbt Core to its Process asset type. Atlan derives its lineage from the Process asset type.

Source property Atlan property
unique_id name
rawSql code
compiledSql sql

Models

Atlan maps models from dbt Core to its Model asset type.

Source property Atlan property
name name
description description
executeCompletedAt sourceUpdatedAt
owner sourceCreatedBy
dynamically generated using accountId, jobId, and uniqueId sourceURL
Source property Atlan dbt-specific property
alias assetDbtAlias
meta assetDbtMeta
uniqueId assetDbtUniqueId
raw_sql or raw_code dbtRawSQL
compiled_sql or compiled_code dbtCompiledSQL
stats dbtStats
config.materialized dbtMaterializationType

Metrics

Atlan maps metrics from dbt Core to its Metric asset type.

Source property Atlan property
name name
description description
executeCompletedAt sourceUpdatedAt
owner sourceCreatedBy
dynamically generated using accountId, jobId, and uniqueId sourceURL
Source property Atlan dbt-specific property
alias assetDbtAlias
meta assetDbtMeta
uniqueId assetDbtUniqueId
tags assetDbtTags
type metricType
sql metricSQL
timestamp metricTimestamp
timeGrains metricTimeGrains
dimensions metricDimensions

Sources

Atlan maps sources from dbt Core to its DbtSource asset type.

Source property Atlan property
name name
description description
executeCompletedAt sourceUpdatedAt
owner sourceCreatedBy
dynamically generated using accountId, jobId, and uniqueId sourceURL
Source property Atlan dbt-specific property
alias assetDbtAlias
meta assetDbtMeta
uniqueId assetDbtUniqueId
tags assetDbtTags
criteria assetDbtSourceFreshnessCriteria
stats dbtStats
state dbtState

Tests

🚨 Careful! For dbt Core, you need to upload the run_results.json file to crawl dbt tests. We recommend uploading the file to the same folder as the manifest.json file.

Atlan maps tests from dbt Core to its Test asset type.

Source property Atlan property
name name
description description
dynamically generated using accountId, jobId, and uniqueId sourceURL
Source property Atlan dbt-specific property
name assetDbtAlias
meta assetDbtMeta
uniqueId assetDbtUniqueId
tags assetDbtTags
status (from run_results) dbtTestStatus
calculated based on status dbtTestState
error (from run_results) dbtTestError
raw_code dbtTestRawCode
raw_sql dbtTestRawSQL
compiled_code dbtTestCompiledCode
compiled_sql dbtTestCompiledSQL
language dbtTestLanguage

Related articles

Was this article helpful?
1 out of 1 found this helpful