Mapping of Cluster and Command TypesΒΆ

The following table shows which types of commands and queries run on each type of Qubole cluster.

Note

To see which Cloud platforms support each type of cluster, and for version information, see QDS Components: Supported Versions and Cloud Platforms.

Caution

Run only Hive DDL commands on a Presto cluster. Running Hive DML commands on a Presto cluster is not supported.

Command Type Airflow Cluster Support Hadoop-2 Cluster Support Presto Cluster Support Spark Cluster Support
Data Export Not Applicable Optional Not Applicable Not Applicable
Data Import Not Applicable Optional Not Applicable Not Applicable
DB Query Not Applicable Not Applicable Not Applicable Not Applicable
Hadoop command No Yes No No
Hive query No Yes Only Hive DDL commands No
Pig query No Yes No No
Presto query No No Yes No
Query Export No Yes No No
Redshift command Not Applicable Not Applicable Not Applicable Not Applicable
Refresh Table command Not Applicable Not Applicable Not Applicable Not Applicable
Shell command Yes Yes No Yes
Spark command No No No Yes

Note

Cluster support for the workflow command depends on the type of commands in the workflow. DB Query, Data Export, Data Import, Redshift, and Refresh Table commands run without a cluster.