What’s New and Key Enhancements
The new features and key enhancements are listed in the corresponding tabs below.
Note
The label (in blue) that is against the description indicates the launch stage, availability, and the default state of the feature/enhancement. For more information, click the label.
Unless stated otherwise, features are generally available, available as self-service and enabled by default.
The default Account Level Concurrent Command Limit on the Account Settings tab has increased from 20 to 100. Gradual Rollout. Learn more.
Qubole now supports IAM role-based account creation via API. Learn more.
To mitigate risk while rolling out a new feature, Qubole groups users, and accounts into different pods. When a change is rolled out to a pod, Qubole monitors the feature’s performance before rolling it out to subsequent pods. You can view the pod you belong to in the Account Details section of the Account Settings tab. Learn more.
Qubole supports new instance types. Learn more.
Configuring Coordinator and Minimum Number of Nodes separately in clusters. Learn more. | Via Support
Disable SSH access to clusters. Learn more. | Feature to opt in | Beta
Cluster health Tile Card with metrics is available in the Clusters UI page. Learn more.
Configure notification channels for a given cluster. Learn more.
Hadoop 2 (Hive) clusters renamed as Hadoop (Hive) clusters with Cluster v2.1 API. Learn more. | Via Support
Learn more about other enhancements and bug fixes.
New Analyze is now Workbench. Beta.
You can resize the command query composer in Workbench for Hive, Presto, Quantum, and DB Query commands.
Permalinks for Hive tables in Workbench now contain an account ID. A confirmation pop-up window prompts users if they open a table that belongs to a different Qubole account.
You can now tag commands on the History tab in Workbench. You can later use these tags to filter out commands using the Tags field (in the history filter).
Cluster live health metrics are now available as part of the Clusters drop-down list in Workbench. Via Support.
Users can use Snowflake, Apache Kafka, and Hive Tables as sinks for creating structured streaming pipelines through QuEST.
A new API is introduced to enlist hive tables along with their views and definitions for a specific database.
Qubole supports configuring buffer capacity in Hadoop and Spark clusters. Learn more.
Qubole supports reserving buffer space in ApplicationMasters on On-Demand nodes. Learn more.
Learn more about other enhancements and bug fixes.
Changes in Hive versions. Learn more.
Hive Notebooks are deprecated. Learn more.
Qubole JDBC Storage Handler will be deprecated. Learn more.
Hadoop 2 (Hive) clusters are renamed as Hadoop (Hive) clusters. Learn more. | Via Support
Improvements in Hive Metastore Server. Learn more. | Via Support
Hive ACID Transactions. Learn more.
Learn more about other enhancements and bug fixes.
Qubole provides JupyterLab interface, which is the next generation user interface for Jupyter, to create and manage Jupyter notebooks. Beta, Via Support. Learn more.
Qubole supports RStudio Pro integration in Spark 2.2 and 2.3 clusters. Beta, Via Support. Learn more.
Qubole supports Zeppelin 0.8.0 upgrade with many enhancements. Feature to opt in. Learn more.
Qubole supports enterprise installations of Github and Gitlab. Via Support. Learn more.
The Environments UI is now available in the Control Panel by default for the new users. Beta.
Presto clusters support spot block nodes rotation. Learn more. | Beta, Via Support
Support for Requester pay buckets in S3. Learn more.
Presto version changes. Learn more.
Cost-based optimization is default in JOIN reordering and redistribution. Learn more.
Session properties are introduced to set required number of worker nodes. Learn more.
Presto notebook enhancements. Learn more.
Disable Reserved Pool. Learn more.
Disable SSH access to Presto clusters. Learn more. | Via Support
Clearing the Hive metastore cache. Learn more.
Presto cluster can access S3 buckets with different configuration. Learn more.
Query retry mechanism is supported in IOW, CTAS, and SELECT queries. Learn more.
Qubole supports optimized local scheduling in splits. Learn more. | Gradual Rollout
Limiting the total bytes scanned in a running query. Learn more.
Performance improvement in queries involving IN and NOT IN over a subquery. Learn more.
Learn more about other enhancements and bug fixes.
Qubole supports Apache Ranger integration with Spark on Spark 2.4.0 and later versions. Feature to opt in | Cluster Restart Required. Learn more.
Spark 2.4.3 is the latest version supported on Spark on Qubole. Learn more.