Atlan crawls and maps the following assets and properties from Databricks.
Databases
Atlan maps databases from Databricks to its Database asset type.
| Source property | Atlan property |
|---|---|
| TABLE_CATALOG | name |
| SCHEMA_COUNT | schemaCount |
Schemas
Atlan maps schemas from Databricks to its Schema asset type.
| Source property | Atlan property |
|---|---|
| TABLE_SCHEMA | name |
| TABLE_COUNT | tableCount |
| VIEW_COUNT | viewsCount |
| TABLE_CATALOG | databaseName |
Tables
Atlan maps tables from Databricks to its Table asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS, DESCRIPTION | description |
| COLUMN_COUNT | columnCount |
| ROW_COUNT | rowCount |
| BYTES, SIZEINBYTES | sizeBytes |
| LOCATION | externalLocation |
| FORMAT | externalLocationFormat |
| CREATEDAT | sourceCreatedAt |
| LASTMODIFIED | sourceUpdatedAt |
| PARTITIONS | isPartitioned, partitionCount, partitionList |
Views
Atlan maps views from Databricks to its View asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS | description |
| COLUMN_COUNT | columnCount |
| CREATETAB_STMT | definition |
| CREATEDAT | sourceCreatedAt |
| LASTMODIFIED | sourceUpdatedAt |
Columns
Atlan maps columns from Databricks to its Column asset type.
| Source property | Atlan property |
|---|---|
| COLUMN_NAME | name |
| REMARKS | description |
| ORDINAL_POSITION | order |
| TYPE_NAME | dataType |
| NULLABLE | isNullable |
| CHAR_OCTET_LENGTH | maxLength |
| DECIMAL_DIGITS | precision |
Stored procedures
Atlan maps stored procedures from Databricks to its Procedure asset type.
| Source property | Atlan property |
|---|---|
| PROCEDURE_NAME | name |
| REMARKS | description |
| PROCEDURE_TYPE | subType |
| ROUTINE_DEFINITION | definition |
