What lineage does Atlan extract from Microsoft Azure Data Factory?

Atlan uses the Microsoft Azure Data Factory REST API to generate lineage associated with Microsoft Azure Data Factory connectors. This is particularly useful for creating lineage between different tools.

Atlan currently only supports lineage for the following:

  • Supported sources and sinks listed below.
  • Data loaded through supported activities in data factory pipelines.
🚨 Careful! The assets involved in lineage must already be crawled by Atlan before running the Microsoft Azure Data Factory package to enrich them.

Specifically, Atlan will:

  • Create lineage between each data asset in Atlan that is associated with a supported Microsoft Azure Data Factory connector. (For example, between Microsoft Azure Cosmos DB collections and ADLS objects.)
    • Atlan creates Microsoft Azure Data Factory Process objects for each data asset that is replicated. Learn more about processes here.

Supported sources and sinks

Sources

Atlan's Microsoft Azure Data Factory integration supports the following sources:

Sinks

Atlan's Microsoft Azure Data Factory integration supports the following sinks:

💪 Did you know? We welcome feedback — have a burning need for another source or sink? Please let us know!

Related articles

Was this article helpful?
0 out of 0 found this helpful