This document provides recommended solutions for integrating Atlan instances hosted on Microsoft Azure with the following:
- Data sources hosted on Microsoft Azure
- Data sources hosted in data centers
Azure-managed data sources
To connect your Atlan instance hosted on Microsoft Azure with a Microsoft Azure-managed data source, Atlan recommends the following method. For this purpose, we'll consider a Microsoft Azure-managed Snowflake instance:
- For data sources like Snowflake, you can use Azure Private Link.
- Atlan will create a private endpoint in your Atlan instance to connect to your Snowflake instance using the the resource ID.
- This will create a request in your Atlan instance. Accept the request to proceed.
- Once the request has been accepted, Atlan will be able to access the data source using a private endpoint over the Azure backbone network, bypassing the internet.
- Atlan will also create a private DNS and add an
A
record for the private endpoint previously created in the Azure-managed Atlan instance and share the details with you. - You can use this DNS record to connect to the Azure-hosted Snowflake data source.
- Each data source will require a separate Azure private endpoint.
On-premises data sources
To connect your Atlan instance hosted on Microsoft Azure with an on-premises data source, Atlan recommends the following method. For this purpose, we'll consider an on-premises MySQL server hosted in a data center:
- For an on-premises MySQL database, you can consider a combination of Azure Private Link, Azure Load Balancer, and Azure Virtual Machines.
- For this method, the data source must be accessible from your Microsoft Azure subscription.
- You will need to create a virtual machine in your Azure-managed Atlan instance to port forward the request to the corresponding data source.
- Add a network load balancer to the virtual machine and create a Private Link service to the load balancer.
- Atlan will create a private endpoint in your Atlan instance to connect to the Private Link service of the load balancer.
- Atlan will also create a private DNS and add an
A
record for the private endpoint previously created in the Azure-managed Atlan instance and share the details with you. - You can use this DNS record to connect to the on-premises data source using the load balancer.
- Only one private endpoint will be required to connect to all the on-premises data sources through port forwarding.