What does Atlan crawl from Hive?

Atlan crawls and maps the following assets and properties from Hive.

Database

Atlan always creates a Database asset called Hive to maintain the three-level hierarchy.

Schemas

Atlan maps schemas from Hive to its Schema asset type.

Source property Atlan property
DATABASE_NAME name
COMMENT description

Tables

Atlan maps tables from Hive to its Table asset type.

Source property Atlan property
tableName name
COMMENT description
column_count columnCount
numRows rowCount
totalSize sizeBytes
numPartitions isPartitioned
numPartitions partitionCount
location externalLocation
inputFormat externalLocationFormat

Views

Atlan maps views from Hive to its View asset type.

Source property Atlan property
tableName name
COMMENT description
column_count columnCount
viewExpandedText definition

Materialized views

Atlan maps materialized views in Hive to its Materialised View asset type.

Source property Atlan property
tableName name
COMMENT description
column_count columnCount
viewExpandedText definition
staleSinceDate materializationTime
numRows rowCount
totalSize sizeBytes

Columns

Atlan maps columns from Hive to its Column asset type.

Source property Atlan property
COL_NAME name
DATA_TYPE dataType
COMMENT description
Detailed Table Information order
Constraints (Primary Key) isPrimary
Constraints (Foreign Key) isForeign

Related articles

Was this article helpful?
0 out of 0 found this helpful