Snowflake process (in Atlan) = Snowflake transformation
Data processing in a warehouse involves a combination of these three processes:
- Extract (from source)
- Load (to warehouse)
- Transformation (of the data between source format and a consolidated format in the warehouse)
Whether run through a Python script, directly from Snowflake’s UI, or via third-party programs like Matillion, these transformations occur within Snowflake through SQL. Regardless of what ran this transformation SQL, a Snowflake process in Atlan captures the transformation logic for use in lineage.