🚨 Careful! Atlan currently only supports mining query history for dedicated SQL pools with the Microsoft Azure Synapse Analytics miner. Mining query history for serverless SQL pools is currently not supported.
Once you have crawled assets from Microsoft Azure Synapse Analytics, you can mine query history to construct lineage.
To mine lineage from Microsoft Azure Synapse Analytics, review the order of operations and then complete the following steps.
Select the miner
To select the Microsoft Azure Synapse Analytics miner:
- In the top right of any screen, navigate to + New and then click New workflow.
- Under Marketplace, from the filters along the top, click Miner.
- From the list of packages, select Synapse Miner and then click Setup Workflow.
Configure the miner
To configure the Microsoft Azure Synapse Analytics miner:
- For Connection, select the connection to mine. (To select a connection, the crawler must have already run.)
- For Miner Extraction Method, choose your extraction method:
- In Query History, Atlan connects to your database and mines query history directly.
- In Offline, you will need to first mine query history yourself and make it available in S3.
Run the miner
To run the Microsoft Azure Synapse Analytics miner, after completing the steps above:
- To run the miner once, immediately, at the bottom of the screen, click the Run button.
- To schedule the miner to run hourly, daily, weekly, or monthly, at the bottom of the screen, click the Schedule & Run button.
Once the miner has completed running, you will see lineage for Microsoft Azure Synapse Analytics assets that were created in Microsoft Azure Synapse Analytics! 🎉