- The quantity of assets being retrieved from the source will affect how long the workflows take to complete.
- The differential crawling features of Atlan's workflows allow them to bring in only the differential or delta changes to the source assets, ensuring that they run more quickly. Additionally, parallelization has been included to ensure further runtime optimization.
- In some cases, the workflow runtime can exceed the usual duration. Typical reasons for this:
- There may be more transformations on some days, hence there must be more delta changes synced into Atlan on such days.
- In the event that one of these conversions also involves a delete operation, Atlan will archive the removed assets. The runtime of the overall workflow is impacted because this archive activity often takes longer to complete.
