Steps 1 and 2 below provide a quick overview of the process.
Step 1: Azure Portal¶
- Navigate to the Azure Portal.
- Follow the instructions in Getting Set Up on Azure (in this Quick Start Guide). Or you can use the Azure documentation if you prefer.
When prompted for the SIGN-ON URL and APP ID URI enter https://azure.qubole.com.
- Make a note of the following credentials:
- Account: Application ID (also known as Client ID), Authentication Key, and Tenant ID.
- For Azure Data Lake: Storage Client ID, Storage Client Secret, Storage Tenant ID, and Subscription ID; OR
- For Azure Blob Storage or ABFS: storage account Name and the Access Keys.
Step 2: QDS Account Settings¶
- Log in to the QDS UI. You can:
If you choose Azure Active Directory, you will be prompted for further information. Respond as follows, then choose Create Access Control.
- Resource Name: Enter the email address you will use for this account.
- Resource Type: Choose email.
- Access Type Allowed: Choose azure_auth.
For the administrative set-up needed, see Setting Up AD Authentication and Data Authorization for Azure Gen 2 Storage.
- Navigate to Account Settings. (More details for the following steps are here).
- On the Account Settings page, scroll down to Storage Settings and add:
- For Azure Data Lake: the Storage Client ID, Storage Client Secret, and Storage Tenant ID.
- For Blob Storage: the Storage Account Name, container (Default Location) and a Storage Access Key.
- For ABFS: the Storage Account Name and a Storage Access Key.
- Scroll down to the Compute Settings and add the Compute Client ID (also known as
Application ID), Compute Client Secret (also known as Authentication Key), Compute Tenant ID, Compute Subscription ID.
- Specify the default Azure Resource Group in which QDS will bring up your clusters.
- Check the box to Push Compute Settings to all clusters.