What does Atlan crawl from dbt Cloud?

Have more questions? Submit a request

Atlan crawls and maps the following assets and properties from dbt Cloud.

Atlan's dbt connectivity also populates custom metadata to further enrich the assets in Atlan. The Atlan dbt-specific property column in the tables below gives the name of the mapped custom metadata property in Atlan.

πŸ’ͺ Did you know? It is also possible to map other metadata on Atlan's assets through your dbt models.

Tables

Atlan maps tables from dbt Cloud to its Table asset type.

Source property Atlan property
description description
alias alias
stats (row_count) rowCount
stats (bytes) sizeBytes
stats (last_modified) sourceUpdatedAt
Source property Atlan dbt-specific property
account (name) Account Name
project (name) Project Name
job (name) Job Name
uniqueId Unique Identifier
rawSql Raw SQL
resourceType Resource Type
tags Tags
config (materialized) Materialisation Type
config (full_refresh) Full Refresh
config (query_tag) Query Tag
config (unique_key) Unique Key
packageName Package Name
path Path
alias Alias
description Description
created_at Created At
compiledSql Compiled SQL
maxLoadedAt Max Loaded At
snapshottedAt Snapshotted At
criteria Freshness Criteria

Columns

Atlan maps columns from dbt Cloud to its Column asset type.

Source property Atlan property
description description
Source property Atlan dbt-specific property
account (name) Account Name
project (name) Project Name
job (name) Job Name
tags Tags
config (query_tag) Query Tag
packageName Package Name
path Path
description Description
created_at Created At

Nodes

Atlan maps nodes from dbt Cloud to its Process asset type. Atlan derives its lineage from the Process asset type.

Source property Atlan property
uniqueId name
rawSql code
compiledSql sql

Models

Atlan maps models from dbt Cloud to its Model asset type.

Source property Atlan property
name name
description description
executeCompletedAt sourceUpdatedAt
owner sourceCreatedBy
dynamically generated using accountId, jobId, and uniqueId sourceURL
Source property Atlan dbt-specific property
alias assetDbtAlias
meta assetDbtMeta
uniqueId assetDbtUniqueId
accountName assetDbtAccountName
projectName assetDbtProjectName
packageName assetDbtPackageName
job.name assetDbtJobName
job.schedule assetDbtJobSchedule
job.status assetDbtJobStatus
job.cron_humanized assetDbtJobScheduleCronHumanized
job.last_run_finished_at assetDbtJobLastRun
job.latest_run.href assetDbtJobLastRunUrl
job.latest_run.created_at assetDbtJobLastRunCreatedAt
job.latest_run.updated_at assetDbtJobLastRunUpdatedAt
job.latest_run.dequeued_at assetDbtJobLastRunDequedAt
job.latest_run.started_at assetDbtJobLastRunStartedAt
job.latest_run.duration assetDbtJobLastRunTotalDuration
job.latest_run.duration_humanized assetDbtJobLastRunTotalDurationHumanized
job.latest_run.queued_duration assetDbtJobLastRunQueuedDuration
job.latest_run.queued_duration_humanized assetDbtJobLastRunQueuedDurationHumanized
job.latest_run.run_duration assetDbtJobLastRunRunDuration
job.latest_run.queued_duration_humanized assetDbtJobLastRunRunDurationHumanized
job.latest_run.git_branch assetDbtJobLastRunGitBranch
job.latest_run.git_branch_sha assetDbtJobLastRunGitSha
job.latest_run.status_message assetDbtJobLastRunStatusMessage
job.latest_run.owner_thread_id assetDbtJobLastRunOwnerThreadId
job.latest_run.executed_by_thread_id assetDbtJobLastRunExecutedByThreadId
job.latest_run.artifacts_saved assetDbtJobLastRunArtifactsSaved
job.latest_run.artifact_s3_path assetDbtJobLastRunArtifactS3Path
job.latest_run.has_docs_generated assetDbtJobLastRunHasDocsGenerated
job.latest_run.has_sources_generated assetDbtJobLastRunHasSourcesGenerated
job.latest_run.notifications_sent assetDbtJobLastRunNotificationsSent
job.next_run assetDbtJobNextRun
job.next_run_humanized assetDbtJobNextRunHumanized
environment.name assetDbtEnvironmentName
environment.dbt_version assetDbtEnvironmentDbtVersion
tags assetDbtTags
status dbtStatus
error dbtError
rawSql dbtRawSQL
compiledSql dbtCompiledSQL
stats dbtStats
materializedType dbtMaterializationType
compileStartedAt dbtModelCompileStartedAt
compileCompletedAt dbtModelCompileCompletedAt
executeStartedAt dbtModelExecuteStartedAt
executeCompletedAt dbtModelExecuteCompletedAt
executionTime dbtModelExecutionTime
runGeneratedAt dbtModelRunGeneratedAt
runElapsedTime dbtModelRunElapsedTime

Metrics

Atlan maps metrics from dbt Cloud to its Metric asset type.

Source property Atlan property
name name
description description
executeCompletedAt sourceUpdatedAt
owner sourceCreatedBy
dynamically generated using accountId, jobId, and uniqueId sourceURL
Source property Atlan dbt-specific property
alias assetDbtAlias
meta assetDbtMeta
uniqueId assetDbtUniqueId
accountName assetDbtAccountName
projectName assetDbtProjectName
packageName assetDbtPackageName
job.name assetDbtJobName
job.schedule assetDbtJobSchedule
job.status assetDbtJobStatus
job.cron_humanized assetDbtJobScheduleCronHumanized
job.last_run_finished_at assetDbtJobLastRun
job.latest_run.href assetDbtJobLastRunUrl
job.latest_run.created_at assetDbtJobLastRunCreatedAt
job.latest_run.updated_at assetDbtJobLastRunUpdatedAt
job.latest_run.dequeued_at assetDbtJobLastRunDequedAt
job.latest_run.started_at assetDbtJobLastRunStartedAt
job.latest_run.duration assetDbtJobLastRunTotalDuration
job.latest_run.duration_humanized assetDbtJobLastRunTotalDurationHumanized
job.latest_run.queued_duration assetDbtJobLastRunQueuedDuration
job.latest_run.queued_duration_humanized assetDbtJobLastRunQueuedDurationHumanized
job.latest_run.run_duration assetDbtJobLastRunRunDuration
job.latest_run.queued_duration_humanized assetDbtJobLastRunRunDurationHumanized
job.latest_run.git_branch assetDbtJobLastRunGitBranch
job.latest_run.git_branch_sha assetDbtJobLastRunGitSha
job.latest_run.status_message assetDbtJobLastRunStatusMessage
job.latest_run.owner_thread_id assetDbtJobLastRunOwnerThreadId
job.latest_run.executed_by_thread_id assetDbtJobLastRunExecutedByThreadId
job.latest_run.artifacts_saved assetDbtJobLastRunArtifactsSaved
job.latest_run.artifact_s3_path assetDbtJobLastRunArtifactS3Path
job.latest_run.has_docs_generated assetDbtJobLastRunHasDocsGenerated
job.latest_run.has_sources_generated assetDbtJobLastRunHasSourcesGenerated
job.latest_run.notifications_sent assetDbtJobLastRunNotificationsSent
job.next_run assetDbtJobNextRun
job.next_run_humanized assetDbtJobNextRunHumanized
environment.name assetDbtEnvironmentName
environment.dbt_version assetDbtEnvironmentDbtVersion
tags assetDbtTags
type metricType
sql metricSQL
timestamp metricTimestamp
timeGrains metricTimeGrains
dimensions metricDimensions

Sources

Atlan maps sources from dbt Cloud to its DbtSource asset type.

Source property Atlan property
name name
description description
executeCompletedAt sourceUpdatedAt
owner sourceCreatedBy
dynamically generated using accountId, jobId, and uniqueId sourceURL
Source property Atlan dbt-specific property
alias assetDbtAlias
meta assetDbtMeta
uniqueId assetDbtUniqueId
accountName assetDbtAccountName
projectName assetDbtProjectName
packageName assetDbtPackageName
job.name assetDbtJobName
job.schedule assetDbtJobSchedule
job.status assetDbtJobStatus
job.cron_humanized assetDbtJobScheduleCronHumanized
job.last_run_finished_at assetDbtJobLastRun
job.latest_run.href assetDbtJobLastRunUrl
job.latest_run.created_at assetDbtJobLastRunCreatedAt
job.latest_run.updated_at assetDbtJobLastRunUpdatedAt
job.latest_run.dequeued_at assetDbtJobLastRunDequedAt
job.latest_run.started_at assetDbtJobLastRunStartedAt
job.latest_run.duration assetDbtJobLastRunTotalDuration
job.latest_run.duration_humanized assetDbtJobLastRunTotalDurationHumanized
job.latest_run.queued_duration assetDbtJobLastRunQueuedDuration
job.latest_run.queued_duration_humanized assetDbtJobLastRunQueuedDurationHumanized
job.latest_run.run_duration assetDbtJobLastRunRunDuration
job.latest_run.queued_duration_humanized assetDbtJobLastRunRunDurationHumanized
job.latest_run.git_branch assetDbtJobLastRunGitBranch
job.latest_run.git_branch_sha assetDbtJobLastRunGitSha
job.latest_run.status_message assetDbtJobLastRunStatusMessage
job.latest_run.owner_thread_id assetDbtJobLastRunOwnerThreadId
job.latest_run.executed_by_thread_id assetDbtJobLastRunExecutedByThreadId
job.latest_run.artifacts_saved assetDbtJobLastRunArtifactsSaved
job.latest_run.artifact_s3_path assetDbtJobLastRunArtifactS3Path
job.latest_run.has_docs_generated assetDbtJobLastRunHasDocsGenerated
job.latest_run.has_sources_generated assetDbtJobLastRunHasSourcesGenerated
job.latest_run.notifications_sent assetDbtJobLastRunNotificationsSent
job.next_run assetDbtJobNextRun
job.next_run_humanized assetDbtJobNextRunHumanized
environment.name assetDbtEnvironmentName
environment.dbt_version assetDbtEnvironmentDbtVersion
tags assetDbtTags
criteria assetDbtSourceFreshnessCriteria
stats dbtStats
state dbtState

Related articles

Was this article helpful?
1 out of 1 found this helpful