🤓 Who can do this? You will probably need your Confluent Kafka administrator to complete these steps — you may not have access yourself.
Atlan supports the API authentication method for fetching metadata from Confluent Kafka. This method uses an API key and API secret to fetch metadata.
Create an API key
💪 Did you know? Atlan does not make any API requests or queries that will update the resources in your Confluent Kafka environment.
To create an API key for crawling Confluent Kafka:
- Log in to your Confluent Cloud instance.
- From the Cloud Console, select your active cluster.
- Under Cluster Overview in the left menu for your active cluster, click API Keys.
- In the upper right of the API Keys page, click + Add key.
- On the Create key page, enter the following details:
- For Access Control, under Select Scope for API key, select Granular access to define a specific set of access rules and then click Next to proceed.
- For Service Account, click Create a new one and enter the following details:
- For New service account name, enter a meaningful name for your API key — for example,
Atlan. - (Optional) For Description, add a description for your API key — for example,
Atlan crawler connection. - Click Next to proceed.
- For New service account name, enter a meaningful name for your API key — for example,
- For Add ACLs to service account, click + Add ACLs to add and allow the following minimum permissions required for your Confluent Kafka resources:
- Cluster:
Describe,DescribeConfigs - Group:
Read,Describe - Topic:
Read,Describe,DescribeConfigs
- Cluster:
- Once you've added all the permissions, click Next to proceed.
- For Create key, under Get your API key, copy or download your API key and secret and store them in a secure location.
🚨 Careful! The API secret cannot be retrieved later.
