What’s New and Key Enhancements¶

The new features and key enhancements are listed in the corresponding tabs below.

Note

The label (in blue) that is against the description indicates the launch stage, availability, and the default state of the feature/enhancement. For more information, click the label.

Unless stated otherwise, features are generally available, available as self-service and enabled by default.

Validate an account using AWS simulation. Beta, Via Support.
New monthly Qubole Compute Unit (QCU) API.
Add a description while allowing an IP address.

Learn more.

Configure Node Bootstrap script at multiple points in the node startup. Cluster Restart Required | Learn more.
EBS volumes are encrypted by default. Learn more.
Proactive replacement of Spot nodes. Learn more.
Supported new cluster instances types in this version. Cluster Restart Required | Learn more.
There are changes in heterogeneous clusters configuration. Gradual Rollout | Cluster Restart Required | Learn more.
Pass cluster configuration properties as cluster overrides. Gradual Rollout | Cluster Restart Required | Learn more.

Learn more about other enhancements and bug fixes.

Workbench (Beta)

Organize your work as Collections as you iteratively build to a final query. Gradual Rollout.
View memory, CPU usage, and Hive Metastore connectivity while selecting a cluster for a Hive, Presto, or Spark command. Gradual Rollout.
Read-only view supported for Spark notebook commands.
Resizable command composer for Spark and Shell commands.
Clusters sorted by Up, Pending, Terminating, and Down.

Learn more.

Quest

Dedicated Streaming cluster for running long running streaming pipelines using Quest.

Health and cost insights from the Events tab of the Quest UI.

Integration with Kafka Registry for the ease of schema input and evolution.

New supported connector: S3-SQS as source.

Ability to clone, archive, and delete a pipeline.

Beta, Learn more.

Customize the User-Agent header in HTTP requests. Learn more.
Access GCP and OCI Cloud Object Storage Objects on AWS Hadoop (Hive) clusters. Learn more.

Learn more about other enhancements and bug fixes.

Automatic Statistics Collections on Hive queries. Via Support | Cluster Restart Required | Learn more.
HiveServer2 enhancements in this version. Disabled | Cluster Restart Required | Learn more.
Multi-instance HiveServer2 enhancements in this version. Via Support | Cluster Restart Required | Learn more.
Hive ACID enhancements in this version. Learn more.
Speed up downscaling in Hadoop (Hive) clusters. Learn more.

Learn more about other enhancements and bug fixes.

Qubole launches a new version of the JupyterLab interface with the following enhancements:
- Integration of Jupyter notebooks with Version Control Systems: GitHub, GitLab, and Bitbucket.
- Ability to schedule Jupyter notebooks from the Scheduler UI.
- Ability to view and edit the Jupyter notebooks when the clusters are down.
- Account level and object level Access Control.
Beta, Via Support.
Enhancements in the Zeppelin 0.8.0 version.
Integration of Zeppelin notebooks with Bitbucket.

Learn more.

Presto 317 (beta) is available with new features. Beta | Cluster Restart Required | Learn more.
Presto supports Hive ACID tables. Learn more.
JOIN Reordering and JOIN type determination based on table size works with partitioned tables. Learn more.
Monitor Presto using Prometheus. Gradual Rollout | Cluster Restart Required | Learn more.
Presto Version 0.193 is deprecated. Learn more.
Proactive removal of unhealthy cluster nodes. Disabled | Cluster Restart Required | Learn more.
Buffer capacity in Presto clusters. Disabled | Cluster Restart Required | Learn more.
Dynamic Filtering improvements are done in this version. Learn more.
Presto query details are available on the Workbench Status Pane. Learn more.

Learn more about other enhancements and bug fixes.

Dynamic Filtering improvements in Spark 2.4.3 and later versions. Learn more.