How to mine Snowflake

Have more questions? Submit a request

Once you have crawled assets from Snowflake you can mine its query history to construct lineage.

To mine lineage from Snowflake, complete the following steps.

Select the miner

To select the Snowflake miner:

  1. In the top right of any screen, navigate to New and then click New Workflow.
  2. From the filters along the top, click Queries.
  3. From the list of packages, select Snowflake Miner and click on Setup Workflow.

Configure the miner

To configure the Snowflake miner:

  1. For Connection, select the connection to mine. (To select a connection, the crawler must have already run.)
  2. For Miner extraction method select Query History.
  3. For Start time choose the earliest date from which to mine query history.
    πŸ’ͺ Did you know? The miner restricts you to only querying the past two weeks of query history. If you need to query more history, for example in an initial load, consider using the S3 miner first. After the initial load you can modify the miner's configuration to use query history extraction.
  4. (Optional) For Control Config, if Atlan support has provided you a custom control configuration, select Custom and enter the configuration into the Custom Config box.

Run the miner

To run the Snowflake miner, after completing the steps above:

  • To run the miner once, immediately, at the bottom of the screen click the Run button.
  • To schedule the miner to run hourly, daily, weekly or monthly, at the bottom of the screen click the Schedule & Run button.

Once the miner has completed running, you will see lineage for Snowflake assets that were created in Snowflake between the start time and when the miner ran! πŸŽ‰

Related articles

Was this article helpful?
0 out of 0 found this helpful