How to automate data quality

πŸ§ͺ Preview feature! This feature is only available to select users for a limited period of time. The purpose of this private preview is to allow participating users to experiment with the feature and provide valuable feedback. If you'd like to participate in the private preview, reach out to your customer success manager for more information.

Data governance and data quality go hand in hand. Atlan has long supported native integrations with Anomalo, Monte Carlo, and Soda to help organizations monitor and improve data quality. Atlan is expanding this support to select data warehouses, starting with Snowflake.

Snowflake's system data metric functions (DMFs) enable defining and enforcing data quality rules at the warehouse level. Atlan's integration with Snowflake in turn empowers users to:

  • Define and enforce data quality rules directly within Atlan.
  • Monitor data quality insights in asset discovery, lineage, and data products.
  • Enhance trust and reliability by making quality metrics visible and actionable.

Supported rules

Atlan supports a set of predefined data quality rules:

  • Blank and null checks β€” blank count, blank percentage, null count, null percentage
  • Freshness metrics β€” data freshness tracking
  • Statistical insights β€” average value, minimum value, maximum value, standard deviation
  • Uniqueness and duplicates β€” duplicate count, unique count

The results of these checks are then classified into core data quality dimensions:

  • Accuracy β€” ensuring correctness and reliability of data
  • Timeliness β€” validating data freshness and latency
  • Validity β€” checking data against predefined formats and constraints
  • Completeness β€” measuring missing or incomplete data

Related articles

Was this article helpful?
0 out of 0 found this helpful