Airflow

Enhancements

• AIR-406: Airflow Version 1.7.0 has been removed from QDS. Airflow version 1.8.2 has been deprecated and will be removed completely in the next major release. It explicitly explains that all active developments on this version of Airflow are stopped. The only two supported Airflow versions are 1.10.0 and 1.10.2.QDS (Cluster Restart Required). It is recommended for users to migrate to these versions.

• AIR-357: Airflow Clusters are now available with an SMTP Agent (Exim) pre-installed on the Instance. This enables all the mailing features of Airflow to work as expected. Add the the email addresses to the approved list of senders on your mail client to ensure that the emails are not directed to the spam folder (Cluster Restart Required).

• AIR-380: To secure the URLs on the internal networks, new password authentication is introduced for the Monit dashboard on Qubole Airflow clusters. The authentication consists of a username and password. The user has to enter Airflow as the Username and the cluster id as the Password (Cluster Restart Required).

• AIR-374: The Remote Sync Location for Dag Explorer is now configurable. The Users can now specify custom S3 as their default storage location from which the Airflow clusters will synchronize user’s DAGs (Cluster Restart Required).

• AIR-390: Now Airflow is supported on New Package Management. New Package Management brings in features like Python 3.7, a new version of Conda, and a lot of fixes on package installation such as support for no-arch packages, and so on (Cluster Restart Required, Disabled, Via Support).