What does Atlan crawl from Google BigQuery?

Have more questions? Submit a request

Once you have crawled Google BigQuery, you can use connector-specific filters for quick asset discovery. The following filters are currently supported for these assets:

  • Tables β€” BigQuery labels filter

For Google BigQuery views and materialized views, Atlan also sends you a cost nudge before viewing a sample data preview. This will inform you about the precise bytes that will be spent during the execution of the query, helping you decide if you would still like to run the preview. Table asset previews are already cost-optimized.

πŸ’ͺ Did you know? You will also receive a cost nudge before querying your Google BigQuery assets.

 

Atlan crawls and maps the following assets and properties from Google BigQuery.

Databases

Atlan maps projects from Google BigQuery to its Database asset type.

Source property Atlan property
Project ID name

Schemas

Atlan maps datasets from Google BigQuery to its Schema asset type.

Source property Atlan property
TABLE_SCHEMA name
TABLE_COUNT tableCount
VIEW_COUNT viewsCount
TABLE_CATALOG databaseName
REMARKS description
CREATED sourceCreatedAt
MODIFIED sourceUpdatedAt

Tables

πŸ’ͺ Did you know? Table asset previews are already cost-optimized. Google BigQuery allows you to use the table preview options to view data for free and without affecting any quotas.

Atlan maps tables from Google BigQuery to its Table asset type.

Source property Atlan property
TABLE_NAME name
REMARKS description
COLUMN_COUNT columnCount
ROW_COUNT rowCount
SIZE_BYTES sizeBytes
TABLE_TYPE subType
CREATED sourceCreatedAt
MODIFIED sourceUpdatedAt
OPTION_NAMES (require_partition_filter) isPartitioned

Views

Atlan maps views from Google BigQuery to its View asset type.

Source property Atlan property
TABLE_NAME name
REMARKS description
COLUMN_COUNT columnCount
TABLE_TYPE subType
CREATED sourceCreatedAt
MODIFIED sourceUpdatedAt
OPTION_NAMES (require_partition_filter) isPartitioned
DDL definition

Materialized views

Atlan maps materialized views from Google BigQuery to its MaterialisedView asset type.

Source property Atlan property
TABLE_NAME name
REMARKS description
COLUMN_COUNT columnCount
ROW_COUNT rowCount
SIZE_BYTES sizeBytes
TABLE_TYPE subType
CREATED sourceCreatedAt
MODIFIED sourceUpdatedAt
OPTION_NAMES (require_partition_filter) isPartitioned
DDL definition

Columns

πŸ’ͺ Did you know? Atlan supports nested columns up to level 1 for Google BigQuery to help you enrich your semi-structured data types. You can view nested columns in the asset sidebar for your table assets.

Atlan maps columns from Google BigQuery to its Column asset type.

Source property Atlan property
COLUMN_NAME name
REMARKS, DESCRIPTION description
ORDINAL_POSITION order
TYPE_NAME dataType
IS_NULLABLE isNullable
IS_PARTITIONING_COLUMN isPartition
CLUSTERING_COLUMN_LIST isClustered

Stored procedures

Atlan maps stored procedures from Google BigQuery to its Procedure asset type.

Source property Atlan property
PROCEDURE_NAME name
REMARKS description
PROCEDURE_TYPE subType
ROUTINE_DEFINITION definition
CREATED sourceCreatedAt
MODIFIED sourceUpdatedAt

Related articles

Was this article helpful?
1 out of 1 found this helpful