Once you have crawled Google BigQuery, you can use connector-specific filters for quick asset discovery. The following filters are currently supported for these assets:
- Tables — BigQuery labels filter
For Google BigQuery views and materialized views, Atlan also sends you a cost nudge before viewing a sample data preview. This will inform you about the precise bytes that will be spent during the execution of the query, helping you decide if you would still like to run the preview. Table asset previews are already cost-optimized.
Atlan crawls and maps the following assets and properties from Google BigQuery.
Databases
Atlan maps projects from Google BigQuery to its Database asset type.
| Source property | Atlan property |
|---|---|
| Project ID | name |
Schemas
Atlan maps datasets from Google BigQuery to its Schema asset type.
| Source property | Atlan property |
|---|---|
| TABLE_SCHEMA | name |
| TABLE_COUNT | tableCount |
| VIEW_COUNT | viewsCount |
| TABLE_CATALOG | databaseName |
| REMARKS | description |
| CREATED | sourceCreatedAt |
| MODIFIED | sourceUpdatedAt |
Tables
Atlan maps tables from Google BigQuery to its Table asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS | description |
| COLUMN_COUNT | columnCount |
| ROW_COUNT | rowCount |
| SIZE_BYTES | sizeBytes |
| TABLE_TYPE | subType |
| CREATED | sourceCreatedAt |
| MODIFIED | sourceUpdatedAt |
| OPTION_NAMES (require_partition_filter) | isPartitioned |
Views
Atlan maps views from Google BigQuery to its View asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS | description |
| COLUMN_COUNT | columnCount |
| TABLE_TYPE | subType |
| CREATED | sourceCreatedAt |
| MODIFIED | sourceUpdatedAt |
| OPTION_NAMES (require_partition_filter) | isPartitioned |
| DDL | definition |
Materialized views
Atlan maps materialized views from Google BigQuery to its MaterialisedView asset type.
| Source property | Atlan property |
|---|---|
| TABLE_NAME | name |
| REMARKS | description |
| COLUMN_COUNT | columnCount |
| ROW_COUNT | rowCount |
| SIZE_BYTES | sizeBytes |
| TABLE_TYPE | subType |
| CREATED | sourceCreatedAt |
| MODIFIED | sourceUpdatedAt |
| OPTION_NAMES (require_partition_filter) | isPartitioned |
| DDL | definition |
Columns
Atlan maps columns from Google BigQuery to its Column asset type.
| Source property | Atlan property |
|---|---|
| COLUMN_NAME | name |
| REMARKS, DESCRIPTION | description |
| ORDINAL_POSITION | order |
| TYPE_NAME | dataType |
| IS_NULLABLE | isNullable |
| IS_PARTITIONING_COLUMN | isPartition |
| CLUSTERING_COLUMN_LIST | isClustered |
Stored procedures
Atlan maps stored procedures from Google BigQuery to its Procedure asset type.
| Source property | Atlan property |
|---|---|
| PROCEDURE_NAME | name |
| REMARKS | description |
| PROCEDURE_TYPE | subType |
| ROUTINE_DEFINITION | definition |
| CREATED | sourceCreatedAt |
| MODIFIED | sourceUpdatedAt |
