Multi-instance HiveServer2

QHIVE-3896: QDS allows you to configure multi-instance HiveServer2 (HS2) in a Hadoop 2 (Hive) cluster. Beta

This provides high availability and scalability when you are running concurrent queries. To run multiple instances of HS2, you can configure a HiveServer2 cluster as a child of the parent Hadoop 2 (Hive) cluster. Qubole recommends you use a multi-instance HS2 cluster when you want to run more than 100 concurrent Hive queries.

QDS allows you to configure a separate HiveServer2 cluster both through the UI and the API. Cluster Restart Required

Hive 3.1.1 (beta) Version

QHIVE-3844: QDS supports Hive 3.1.1 (Beta). It is also the latest release of open-source Hive. Beta

Hive 3.1.1 (Beta) requires Hadoop 3.x and Tez 0.9.x; it supports HS2 and multi-instance HS2. Tez is the only supported execution engine. Cluster Restart Required

Tez UI

QTEZ-405: Adds offline support for the Tez UI.

Bug Fix

  • QTEZ-362: To reduce read API calls in Hive 2.3, QDS has changed the default values of following configurations:

    • mapred.min.split.size: The default value is 256MB.
    • mapred.max.split.size: The default value is 256MB.

    The default values for other Hive versions remain unchanged.