A common question that data teams often face is how to automate metadata at scale.
Having started out as a data team ourselves, we know that automating repetitive tasks can help data teams maximize the value they provide to their organization. One way of doing so is through Atlan's playbooks!
Playbooks help power metadata automation for your data assets in Atlan. Users can create rule-based automations at scale and update metadata in bulk, helping streamline their workflows.
You can update the following asset metadata using playbooks:
For example, imagine your organization needs to transfer ownership of several data assets. Instead of your data team manually updating the ownership of each and every asset, you could create a playbook to automate this process and update the metadata of your assets at scale.
To create a playbook, complete the following steps.
Create a playbook
To create a playbook in Atlan:
- In the left menu in Atlan, click Governance.
- Under the Governance heading of the Governance center, click Playbooks.
- Click Create New to get started.
- In the Create new playbook dialog box, enter the following details:
- For Name, enter a name for the task to be accomplished β such as
Update ownership
. - (Optional) For Description, enter a description.
- (Optional) Select an icon for your playbook.
- For Name, enter a name for the task to be accomplished β such as
- Click Create to save your playbook.
Set up rules as filters
To set up rules as filters for your playbook:
- In the Build Rules page of your playbook, click Filters.
- For name, add a name to your filter.
- To set a matching condition for the filters, select Match all or Match any. Match all will logically
AND
the criteria, while Match any will logicallyOR
the criteria. - For Attributes, select the relevant option. For this example, we'll click Connection and then select a Snowflake connection. (Optional) To further refine your asset selection:
- Click All databases to filter by databases in a selected connection.
- Click All schemas to filter by schemas in a selected connection.
- For Operator, select Is one of for values to include or Is not for values to exclude. Depending on the selected attribute(s), you can also choose from additional operators:
- Select Equals (=) or Not Equals (!=) to include or exclude assets through exact match search.
- Select Starts With or Ends With to filter assets using the starting or ending sequence of values.
- Select Contains or Does not contain to find assets with or without specified values contained within the attribute.
- Select Pattern to filter assets using supported Elastic DSL regular expressions.
- Select Is empty to filter assets with null values.
- For Values, select the relevant values. The values will vary depending on the selected attributes.
- (Optional) To add more filters, click Add filter and select Filter to add individual filters or Filter Group to nest more filters in a group.
- (Optional) To view all the assets that match your rules, in the Filters card, click View all for a preview.
Select the actions
To select the actions to be performed based on your rules:
- In the Build Rules page of your playbook, click Actions.
- For Select Action, select the relevant metadata option to update. For this example, we'll select
Owners
to update the ownership of the assets. - For Select operator, select the relevant option. The operators will vary depending on the selected action.
- For Values, select the relevant option(s). The values will vary depending on the selected actions.
- (Optional) To add more actions, click Add Action.
Run the playbook
If you'd like to continue working on your playbook, you can save it as a draft. If your playbook is ready, you can proceed to running it.
To run the playbook:
- You can either:
- To run the playbook once immediately, click Run once.
- To schedule the playbook to run hourly, daily, weekly, or monthly, click Schedule and choose the preferred frequency, timezone, and time.
- Click Complete to run the playbook.
- In the resulting screen, click Go to profile to view your playbook profile.
Once your playbook has completed its run, you will see the metadata updated for your assets! π