Mapping of Cluster and Command Types

The following table shows which types of commands and queries run on each type of Qubole cluster.

Note

To see which Cloud platforms support each type of cluster, and for version information, see QDS Components: Supported Versions and Cloud Platforms.

Caution

Run only Hive DDL commands on a Presto cluster. Running Hive DML commands on a Presto cluster is not supported.

Command Type	Airflow Cluster Support	Hadoop-2 Cluster Support	Presto Cluster Support	Spark Cluster Support
Data Export	Not Applicable	Optional	Not Applicable	Optional
Data Import	Not Applicable	Optional	Not Applicable	Optional
DB Query	Not Applicable	Not Applicable	Not Applicable	Not Applicable
Hadoop command	No	Yes	No	No
Hive query	No	Yes	Only Hive DDL commands	No
Pig query	No	Yes	No	No
Presto query	No	No	Yes	No
Query Export	No	Yes	No	No
Redshift command	Not Applicable	Not Applicable	Not Applicable	Not Applicable
Refresh Table command	Not Applicable	Not Applicable	Not Applicable	Not Applicable
Shell command	Yes	Yes	No	Yes
Spark command	No	No	No	Yes

Note

Cluster support for the workflow command depends on the type of commands in the workflow. DB Query, Data Export, Data Import, Redshift, and Refresh Table commands run without a cluster.