What does Atlan crawl from Amazon Athena?

Atlan crawls and maps the following assets and properties from Amazon Athena.

Databases

Atlan maps databases from Amazon Athena to its Database asset type.

Source property Atlan property
TABLE_CATALOG name
SCHEMA_COUNT schemaCount

Schemas

Atlan maps schemas from Amazon Athena to its Schema asset type.

Source property Atlan property
TABLE_SCHEMA name
TABLE_COUNT tableCount
VIEW_COUNT viewsCount
TABLE_CATALOG databaseName
CreateTime (via Glue) sourceCreatedAt

Tables

Atlan maps tables from Amazon Athena to its Table asset type.

Source property Atlan property
TABLE_NAME name
REMARKS description
COLUMN_COUNT columnCount
recordCount (via Glue) rowCount
sizeKey (via Glue) sizeBytes
TABLE_TYPE subType
StorageDescriptor Location (via Glue) externalLocation
StorageDescriptor typeOfData (via Glue) externalLocationFormat
StorageDescriptor Columns and COLUMN_COUNT certificateStatus (DEPRECATED) if Athena JDBC and Glue API do not have the same column count
PartitionKeys (via Glue) isPartitioned
PartitionData (via Glue) partitionCount
PartitionData (via Glue) partitionList
CreatedBy (via Glue) sourceCreatedBy
CreateTime or CreationTime (via Glue) sourceCreatedAt
UpdateTime or LastAccessTime (via Glue) sourceUpdatedAt

Views

Atlan maps views from Amazon Athena to its View asset type.

Source property Atlan property
TABLE_NAME name
REMARKS description
COLUMN_COUNT columnCount
VIEW_DEFINITION definition
StorageDescriptor Columns and COLUMN_COUNT certificateStatus (DEPRECATED) if Athena JDBC and Glue API do not have the same column count
recordCount (via Glue) rowCount
PartitionKeys (via Glue) isPartitioned
PartitionData (via Glue) partitionCount
PartitionData (via Glue) partitionList
CreatedBy (via Glue) sourceCreatedBy
CreateTime or CreationTime (via Glue) sourceCreatedAt
UpdateTime or LastAccessTime (via Glue) sourceUpdatedAt

Columns

Atlan maps columns from Amazon Athena to its Column asset type.

Source property Atlan property
COLUMN_NAME name
REMARKS description
ORDINAL_POSITION order
TYPE_NAME dataType
NULLABLE isNullable
IS_PARTITION isPartition
PARTITION_ORDER partitionOrder
PRIMARY_KEY isPrimary
DECIMAL_DIGITS precision

Related articles

Was this article helpful?
1 out of 1 found this helpful