What does Atlan crawl from AWS Glue?

Have more questions? Submit a request

Atlan crawls and maps the following assets and properties from AWS Glue.

Databases

Atlan maps databases from AWS Glue to its Database asset type.

Source property Atlan property
TABLE_CATALOG name
SCHEMA_COUNT schemaCount

Schemas

Atlan maps schemas from AWS Glue to its Schema asset type.

Source property Atlan property
TABLE_SCHEMA name
TABLE_COUNT tableCount
VIEW_COUNT viewsCount
TABLE_CATALOG databaseName
REMARKS description
CreateTime sourceCreatedAt

Tables

Atlan maps tables from AWS Glue to its Table asset type.

Source property Atlan property
TABLE_NAME name
REMARKS description
COLUMN_COUNT columnCount
ROW_COUNT rowCount
BYTES sizeBytes
Parameters (recordCount) rowCount
Parameters (sizeKey) sizeBytes
TABLE_TYPE subType
StorageDescriptor (Location) externalLocation
Parameters (typeOfData, classification) externalLocationFormat
PartitionKeys isPartitioned
PartitionData partitionCount, partitionList
CreatedBy sourceCreatedBy
CreateTime, CreationTime sourceCreatedAt
UpdateTime, LastAccessTime sourceUpdatedAt

Views

Atlan maps views from AWS Glue to its View asset type.

Source property Atlan property
TABLE_NAME name
REMARKS description
COLUMN_COUNT columnCount
VIEW_DEFINITION definition
Parameters (recordCount) rowCount
PartitionKeys isPartitioned
PartitionData partitionCount, partitionList
CreatedBy sourceCreatedBy
CreateTime, CreationTime sourceCreatedAt
UpdateTime, LastAccessTime sourceUpdatedAt

Related articles

Was this article helpful?
0 out of 0 found this helpful