What does Atlan crawl from Databricks?

Have more questions? Submit a request

Atlan crawls and maps the following assets and properties from Databricks.

Databases

Atlan maps databases from Databricks to its Database asset type.

Source property Atlan property
TABLE_CATALOG name
SCHEMA_COUNT schemaCount

Schemas

Atlan maps schemas from Databricks to its Schema asset type.

Source property Atlan property
TABLE_SCHEMA name
TABLE_COUNT tableCount
VIEW_COUNT viewsCount
TABLE_CATALOG databaseName

Tables

Atlan maps tables from Databricks to its Table asset type.

Source property Atlan property
TABLE_NAME name
REMARKS, DESCRIPTION description
COLUMN_COUNT columnCount
ROW_COUNT rowCount
BYTES, SIZEINBYTES sizeBytes
LOCATION externalLocation
FORMAT externalLocationFormat
CREATEDAT sourceCreatedAt
LASTMODIFIED sourceUpdatedAt
PARTITIONS isPartitioned, partitionCount, partitionList

Views

Atlan maps views from Databricks to its View asset type.

Source property Atlan property
TABLE_NAME name
REMARKS description
COLUMN_COUNT columnCount
CREATETAB_STMT definition
CREATEDAT sourceCreatedAt
LASTMODIFIED sourceUpdatedAt

Columns

Atlan maps columns from Databricks to its Column asset type.

Source property Atlan property
COLUMN_NAME name
REMARKS description
ORDINAL_POSITION order
TYPE_NAME dataType
NULLABLE isNullable
CHAR_OCTET_LENGTH maxLength
DECIMAL_DIGITS precision

Stored procedures

Atlan maps stored procedures from Databricks to its Procedure asset type.

Source property Atlan property
PROCEDURE_NAME name
REMARKS description
PROCEDURE_TYPE subType
ROUTINE_DEFINITION definition

Related articles

Was this article helpful?
0 out of 0 found this helpful