What’s New
Important new features and improvements are as follows.
Note
Blue text next to a description in these Release Notes indicates the launch state, availability, and default state of the item. For more information, click the label. Unless otherwise stated, features are generally available, available as self-service (without intervention by Qubole support), and enabled by default.
Oracle-Specific Improvements
QDS on Oracle now supports:
Airflow package management.
A round-robin option to help allocate resources evenly in clusters configured to use multiple availability domains. Via Support, Disabled.
Other Important Improvements
Other important QDS improvements appear under the tabs below:
Master/Worker terminology is now used in the QDS UI instead of Master/Slave.
QDS now supports Oracle Cloud instance free-form tags
QDS now supports a round-robin option to help allocate resources evenly in clusters configured to use multiple avialability domains.
You can use your own Prometheus setup for metrics.
QDS now supports Apache Airflow v1.10.0. You can choose it from the Airflow Version drop-down list on the Clusters page of the QDS UI. Learn more
Sqoop has been upgraded to 1.4.7 (Cluster Restart Required). Via Support, Disabled
Hive 2.3 (Beta) is available. You can choose it when you configure a Hadoop 2 (Hive) cluster. (Cluster Restart Required). Beta.
Multi-column data from a Hive query result is displayed in the Results tab of the Analyze UI page. Via Support.
A detailed log is now available for each Hive query that is executed using HiveServer2 or Hive-on-coordinator. Via Support.
Spark 2.3 is now the default version for Spark clusters.
Spark on Qubole now supports Hive Admin commands that allow users to grant privileges such as SELECT, UPDATE, INSERT and DELETE to other users or roles.
The multi-tenant Qubole Job History Server has been upgraded to Spark 2.3 (2.3.1 by default). This server makes available the logs and history of Spark jobs that ran on clusters that have since been terminated.