Before running the Google BigQuery crawler, you can run preflight checks to perform the necessary technical validations.
testIamPermissions()
method, which is used for permission testing in Atlan through REST API.The following preflight checks will be completed:
Authorization
Each request requires an OAuth 2.0 access token generated via the service account key.
Assets
Metadata crawling permission
β
Check successful
β Check failed. Not all permission granted. Missing permissions:
Query and review permission
β
Check successful
β Check failed. Not all permission granted. Missing permissions:
Miner
Miner policy
Query history
β
Check successful
β Check failed. Not all permission granted. Missing permissions:
S3
β
Check successful
if the bucket, region, and prefix combination is valid and the S3 credential passed is accessible.
β Check failed with error code <AWS error code> - <AWS SDK ERR message>
For example: Miner S3 credentials: failed with error code: NoSuchBucket
Crawler workflow
This checks if the selected connection exists in Atlan.
β
Check successful
β Check failed. Connection does not exist.
/ Check failed. Workflow artifacts are missing. Please run the crawler workflow again.