Notebooks and Dashboards

Jupyter Notebooks (Beta)

New Features

  • JUPY-544: Jupyter notebooks provide Qviz with the Spark driver. Qviz allows you to visualize dataframes with improved charting options and Python plots. Gradual Rollout.
  • JUPY-574 and JUPY-573: You can now drag and drop objects such as tables and columns from the Object Storage Explorer to cells in a Jupyter Notebook.
  • JUPY-302: You can now transfer data from the local kernel to Spark using %%send_to_spark magic.
  • JUPY-578: Jupyter Notebooks can now be enabled by customers through the Feature Opt-in page.

Enhancements

  • JUPY-29: Provides docstring help in Pyspark notebooks by means of the shortcut Shift+Tab.
  • JUPY-571: You can now push Jupyter notebooks without output to the VCS system.
  • JUPY-614, JUPY-613, and JUPY-598: You can now view Hot Tables, Database Views, and Partitioned Columns from the Table Explorer.
  • JUPY-650: You can now search for clusters using the Cluster selection widget when offline notebooks are enabled and more than five clusters are in the list.
  • JUPY-662: When running a Jupyter notebook using the REST API, you can now use the upload_to_source parameter to specify whether the original notebook should be updated.
  • JUPY-667: In isolated mode, the Livy session name is now unique, to facilitate multiple executions of a notebook in parallel.

Bug Fixes

  • JUPY-694: Fixes a problem that caused the Spark session to be terminated when there were active tasks.
  • JUPY-603: Fixes a problem that caused Spark application startup to fail because of a conflict with some third party JARs.

Zeppelin Notebooks

Enhancements

  • ZEP-3231: Users can view data values for individual bars on top of single bar charts.
  • ZEP-4327: Disables default pre-fetching of the datasets to be shown in the Table Explorer on the Notebooks page of the QDS UI, to prevent performance problems when there is a large number of datasets. Contact Qubole Support to enable pre-fetching.

Bug Fixes

  • ZEP-4497: Code highlighting in Zeppelin notebooks was lost intermittently in both offline and online modes. This issue is fixed.
  • ZEP-4588: The Run all option submitted only loaded paragraphs instead of submitting all the paragraphs in a Zeppelin notebook. This issue is fixed.
  • ZEP-4303: Old paragraph results were displayed after the new paragraph run had started. This issue is fixed.
  • ZEP-4040: Terminates the Conda process for Python packages after 20 minutes of inactivity. You can configure this timeout by means of the quboled.package_installation_timeout variable.