What’s New¶

Important new features and improvements are as follows.

Note

Blue text next to a description in these Release Notes indicates the launch state, availability, and default state of the item. For more information, click the label. Unless otherwise stated, features are generally available, available as self-service (without intervention by Qubole support), and enabled by default.

Azure-Specific Improvements¶

Presto FastPath optimizations reduce QDS driver command latency.
RubiX caching on Spark clusters improves query performance. Via Support, Disabled
QDS Azure now supports Airflow package management.

Other Important Improvements¶

Other important QDS improvements appear under the tabs below:

Master/Worker terminology is now used in the QDS UI instead of Master/Slave.

See all the changes.

You can use your own Prometheus setup for metrics.
QDS now supports Apache Airflow v1.10.0. You can choose it from the Airflow Version drop-down list on the Clusters page of the QDS UI. Learn more
Sqoop has been upgraded to 1.4.7 (Cluster Restart Required). Via Support, Disabled

See all the changes.

Hive 2.3 (Beta) is available. You can choose it when you configure a Hadoop 2 (Hive) cluster. (Cluster Restart Required). Beta.
Multi-column data from a Hive query result is displayed in the Results tab of the Analyze UI page. Via Support.
A detailed log is now available for each Hive query that is executed using HiveServer2 or Hive-on-coordinator. Via Support.

See all the changes.

QDS now supports Presto Strict Mode to help guard against unduly expensive Presto queries. (Cluster Restart Required). Beta, Disabled
QDS now supports Apache Ranger integration with Presto for granular access control. Beta, Disabled

See all the changes.

The multi-tenant Qubole Job History Server has been upgraded to Spark 2.3 (2.3.1 by default). This server makes available the logs and history of Spark jobs that ran on clusters that have since been terminated.
Spark on Qubole now supports Hive Admin commands that allow users to grant privileges such as SELECT, UPDATE, INSERT and DELETE to other users or roles.

See all the changes.