What’s New and Key Enhancements

The new features and key enhancements are listed in the corresponding tabs below.

Note

The label (in blue) that is against the description indicates the launch stage, availability, and the default state of the feature/enhancement. For more information, click the label.

Unless stated otherwise, features are generally available, available as self-service and enabled by default.

Administration
Cluster Management
Data Analytics
Data Engineering
Hadoop
Hive
Notebooks and Dashboards
Presto
Spark
  • The default Account Level Concurrent Command Limit on the Account Settings tab has increased from 20 to 100. Gradual Rollout. Learn more.
  • Qubole now supports IAM role-based account creation via API. Learn more.
  • To mitigate risk while rolling out a new feature, Qubole groups users, and accounts into different pods. When a change is rolled out to a pod, Qubole monitors the feature’s performance before rolling it out to subsequent pods. You can view the pod you belong to in the Account Details section of the Account Settings tab. Learn more.

Learn more about other enhancements and bug fixes.

  • New Analyze is now Workbench. Beta.
  • You can resize the command query composer in Workbench for Hive, Presto, Quantum, and DB Query commands.
  • Permalinks for Hive tables in Workbench now contain an account ID. A confirmation pop-up window prompts users if they open a table that belongs to a different Qubole account.
  • You can now tag commands on the History tab in Workbench. You can later use these tags to filter out commands using the Tags field (in the history filter).
  • Cluster live health metrics are now available as part of the Clusters drop-down list in Workbench. Via Support.

Learn more.

  • Users can use Snowflake, Apache Kafka, and Hive Tables as sinks for creating structured streaming pipelines through QuEST.

    Learn more.

  • A new API is introduced to enlist hive tables along with their views and definitions for a specific database.

  • Qubole supports configuring buffer capacity in Hadoop and Spark clusters. Learn more.
  • Qubole supports reserving buffer space in ApplicationMasters on On-Demand nodes. Learn more.

Learn more about other enhancements and bug fixes.

Learn more about other enhancements and bug fixes.

  • Qubole provides JupyterLab interface, which is the next generation user interface for Jupyter, to create and manage Jupyter notebooks. Beta, Via Support. Learn more.
  • Qubole supports RStudio Pro integration in Spark 2.2 and 2.3 clusters. Beta, Via Support. Learn more.
  • Qubole supports Zeppelin 0.8.0 upgrade with many enhancements. Feature to opt in. Learn more.
  • Qubole supports enterprise installations of Github and Gitlab. Via Support. Learn more.
  • The Environments UI is now available in the Control Panel by default for the new users. Beta.
  • Presto clusters support spot block nodes rotation. Learn more. | Beta, Via Support
  • Support for Requester pay buckets in S3. Learn more.
  • Presto version changes. Learn more.
  • Cost-based optimization is default in JOIN reordering and redistribution. Learn more.
  • Session properties are introduced to set required number of worker nodes. Learn more.
  • Presto notebook enhancements. Learn more.
  • Disable Reserved Pool. Learn more.
  • Disable SSH access to Presto clusters. Learn more. | Via Support
  • Clearing the Hive metastore cache. Learn more.
  • Presto cluster can access S3 buckets with different configuration. Learn more.
  • Query retry mechanism is supported in IOW, CTAS, and SELECT queries. Learn more.
  • Qubole supports optimized local scheduling in splits. Learn more. | Gradual Rollout
  • Limiting the total bytes scanned in a running query. Learn more.
  • Performance improvement in queries involving IN and NOT IN over a subquery. Learn more.

Learn more about other enhancements and bug fixes.