How to create data products

πŸ§ͺ Preview feature! This feature is available for your experimentation, and we'd love your feedback. It may change before its final generally-available form.
πŸ€“ Who can do this? Before you can create a data product, you will need your Atlan admin to enable the products module in your Atlan workspace. Once enabled, first review the order of operations. You will need to have create, update, and delete permissions through domain policies for the specific domain or subdomain to create and manage data products.

Data products help your data consumers easily discover and work with data assets. As you get started, here are some questions to consider:

  • What use case(s) are you trying to solve as an organization?
  • How to define a common vocabulary and approach for creating data products and ensuring interoperability across domains?
  • How to design data products to power discovery and drive usage among data consumers?

Data products in Atlan can be highly adaptable to the needs of your organization.

Create a data product

To create a data product, complete these steps.

Provide details

To create a data product:

  1. From the left menu of any screen in Atlan, click Products.
  2. To select a domain or subdomain, you can either:
    • From the navigation menu on the Products homepage, use the search bar or select the relevant domain or subdomain.
    • From the top right of Discover domains, select your data domain of interest. If you cannot find your data domain, click the View all button to view more domains.
  3. In the upper right of your data domain or subdomain page, click the + Add button, and then from the dropdown, click New product to add a new data product.
  4. (Optional) For Cover, click the Change button to select an image from the gallery or upload an image of your own. Click Reposition to drag and reposition the cover image and then click Save position to save your preferences.
  5. For Name, enter a meaningful name for your data product β€” for example, Social Media Analytics.
  6. For Domain, select a data domain from the dropdown β€” for example, Customer Service.
  7. (Optional) For Description, enter a description for your domain.
  8. (Optional) For Criticality, select a level of business criticality from the dropdown β€” choose from High, Medium, and Low.
  9. (Optional) For Sensitivity, assign a data sensitivity level from the dropdown β€” choose from Public, Internal, and Confidential.
  10. (Optional) For Owners, assign additional users or groups as data product owner.
  11. (Optional) For Visibility, select who can access and monitor the data product throughout its entire lifecycle:
    • Private to members of this domain β€” only members of a specific domain can access the data product.
    • Private to selected members β€” only members of a specific domain and other selected users or groups can access the data product.
    • Public β€” everyone in the organization can access the data product.
  12. In the top right of the screen, click the Continue button.

Select assets

To select assets to include in the data product:

  1. Under Select assets, add existing assets in Atlan to your data products.
  2. To set a matching condition for the filters, select Match all or Match any. Match all will logically AND the criteria, while Match any will logically OR the criteria.
  3. For Attributes, select a relevant option:
    • Click Connection and then select an existing connection. (Optional) To further refine your asset selection:
      1. Click All databases to filter by databases in a selected connection.
      2. Click All schemas to filter by schemas in a selected connection.
    • Click Connector to filter assets by supported connectors.
    • Click Asset type to filter by specific asset types β€” for example, tables, columns, queries, glossaries, and more.
    • Click Certificate to filter assets by certification status.
    • Click Owners to filter assets by asset owners.
    • Click Tags to filter assets by your tags in Atlan, including imported Snowflake and dbt tags. 
    • Click Glossary, terms, & categories to filter by a specific glossary or category to bulk update all the nested terms or by multiple glossaries and categories.
    • Click Linked terms to filter assets by linked terms.
    • Click Schema qualified Name to filter assets by the qualified name of a given schema.
    • Click Database qualified Name to filter assets by the qualified name of a given database.
    • Click dbt to filter assets by dbt-specific filters and then select a dbt Cloud or dbt Core filter.
    • Click Properties to filter assets by common asset properties.
    • Click Usage to filter assets by usage metrics.
    • Click Monte Carlo to filter assets by Monte Carlo-specific filters.
    • Click Soda to filter assets by Soda-specific filters.
    • Click Table/View to filter tables or views by row count, column count, or size.
    • Click Column to filter columns by column-specific filters, including parent asset type or name, data type, or column keys.
    • Click Process to filter lineage processes by the SQL query.
    • Click Query to filter assets by associated visual queries.
    • Click Measure to filter Microsoft Power BI measures using the external measures filter.
  4. For Operator, select Is one of for values to include or Is not for values to exclude. Depending on the selected attribute(s), you can also choose from additional operators:
    • Select Equals (=) or Not Equals (!=) to include or exclude assets through exact match search.
    • Select Starts With or Ends With to filter assets using the starting or ending sequence of values.
    • Select Contains or Does not contain to find assets with or without specified values contained within the attribute.
    • Select Pattern to filter assets using supported Elastic DSL regular expressions.
    • Select Is empty to filter assets with null values.
  5. For Values, select the relevant values. The values will vary depending on the selected attributes.
  6. (Optional) To add more filters, click Add filter and select Filter to add individual filters or Filter Group to nest more filters in a group.
  7. (Optional) To view all the assets that match your rules, in the Filters card, click View assets for a preview.
  8. In the top right of the screen, click the Continue button.

(Optional) Select output ports

To select output ports:

  1. From the list of assets, select output port(s) to allow your data consumers to consume the data product across domains. These assets will serve as the consumption layer for your data product.
  2. For Input ports, Atlan displays a total count of input ports for your data product. These assets are designated as output ports in other data products, and serve as input ports for your data product. Click View assets to view all input port assets.
  3. In the top right of the screen, click the Continue button.

Review the data product

  • Review your data product and click Publish.

Congrats on creating your data product in Atlan! πŸŽ‰

Update a data product

Once you have created a data product, you will also need to monitor and manage it during its entire lifecycle. This helps ensure that the data product stays fresh, up-to-date, and trustworthy. The data product profile in Atlan allows you to curate how your users can use the data product.

To update a data product:

  1. From the left menu of any screen in Atlan, click Products.
  2. To select a data product, you can either:
    • From the navigation menu on the Products homepage, use the search bar or expand the relevant domain or subdomain.
    • From the top right of Discover domains, select your domain of interest. If you cannot find your data domain, click the Browse all button to view more domains.
  3. On your data domain page, next to the Overview tab, click the Products tab and select your data product of interest.
    • (Optional) From the top right of the product profile, click the Active dropdown to update the status of your data product:
      • Active β€” data product is active for users to consume.
      • Sunset β€” data product is planned for retirement.
      • Archived β€” data product is archived and will no longer be available to users.
    • Under Summary, view details about the data domain your data product belongs to, including criticality, sensitivity, and freshness.
      • (Optional) Click the pencil icon to update Criticality to signify business impact:
        • High β€” high business impact
        • Medium β€” moderate business impact
        • Low β€” internal or a non-business impact
      • (Optional) Click the pencil icon to update Sensitivity to assign a data classification:
        • Public β€” may be freely accessible
        • Internal β€” may only be distributed within the organization
        • Confidential β€” may only be limited to a specific domain or team within the organization
      • (Optional) Click Add resource to add a resource to your asset.
    • Under Product Score, view a scorecard for your data product, calculated based on metadata completeness.
    • Under At A Glance, view a total count of linked assets and output ports.
    • Under Readme, click + Add to add a README to your data product or use Atlan AI for documentation.
    • Under Details, you can view and update metadata for your data product β€” including visibility, terms, owners, tags, and certificates.
  4. Switch to the Assets tab to view linked assets.
    • (Optional) Click the Edit button to add or remove assets from your data product.
    • (Optional) Select an asset to view its asset profile in a sidebar.
    • (Optional) Filter assets by asset types β€” for example, use the Table filter to view table assets only.
    • (Optional) Click Disable as output port to remove an output port or click Set as output port to set an asset as an output port.
  5. Switch to the Lineage tab to view business lineage for your data product.
    • Hover over any data product to view the metadata popover for more context.
    • Click the view output ports menu to view output ports for your data product.
    • In the upper right of the lineage graph, click the downward arrow to download an image of the product lineage graph.
  6. Switch to the Activity tab to view the activity log for your data product.
  7. Contracts tab β€” coming soon!
  8. From the top right of the data product profile:
    • Click the user avatars to view a list of recently visited users, total views on your asset, total number of unique visitors, and total views by user.
      • Use the days filter to filter asset views and user activity in the last 7, 30, and 90 days.
      • This feature is turned on by default β€” admins can turn off user activity.
    • Click the star button to star your data product and bookmark it for easy access.
    • Click the Slack or Teams icon to post on a Slack or Microsoft Teams channel.
    • Click the 3-dot icon to add an announcement or a resource to your data product.
πŸ’ͺ Did you know? To programmatically create, update, and manage data products using API, refer to our developer documentation.

Related articles

Was this article helpful?
0 out of 0 found this helpful