Airflow

Enhancements

  • AIR-481: QDS-SDK version on the airflow cluster is upgraded to 1.13.2 (Cluster Restart Required).

  • AIR-474: Airflow version 1.8.2 is already deprecated. Now the users cannot create or clone to Airflow 1.8.2 clusters. However, they can edit the existing clusters.

  • AIR-436: Now the users are restricted to start not more than one Airflow cluster on the same datastore. This change is done to prevent the database to go into an inconsistent state when Airflow with different versions share a common data store.

  • AIR-404: The users can now provide custom on_failure_callback for QuboleCheckOperator just like QuboleOperator. It allows users to define a custom callback if the QuboleCheckOperator fails (Cluster Restart Required).