What’s New
Important new features and improvements are as follows:
Note
A link in blue text next to a description in these Release Notes indicates the launch state, availability, and default state of the item (for example, Beta). The link provides more information. Unless otherwise stated, features are generally available, available as self-service (without intervention by Qubole support), and enabled by default.
A QDS adminstrator can now configure a warning timeout, and receive a notification for queries or commands that exceed it. They can choose to cancel these queries. Admins can also configure a kill timeout to kill queries exceeding it.
The Clusters page of the QDS UI displays a new cluster health tile card with metrics.
A new version of the Analyze page, previously released as New Analyze, is now called Workbench. Beta.
Cluster monitoring, includng daemon status, heap usage and coordinator node metrics, is available in Workbench and a REST API.
QDS now allows you to configure buffer capacity in Hadoop and Spark clusters. Learn more.
QDS Hadoop now allows more containers per node, improving memory management in YARN.
Hive 2.3 is generally available. Learn more.
Qubole JDBC Storage Handler is deprecated. Learn more.
QDS now supports Zeppelin 0.8.0.
QDS now supports enterprise installations of Github and Gitlab. Via Support.
QDS R57 provides Package Management version 2 with the latest versions of Anaconda, Python 3.7 and 2.7, and R 3.5. The Control Panel in the QDS UI now includes the Environments page by default for new users. Beta.
Ranger support for Spark is now available in Beta.
Qubole supports Apache Ranger integration with Spark on Spark 2.4.0 and later versions. Beta, Via Support.
Spark 2.4.3 is generally available.