4. How does Qubole access data in my Cloud object store?

QDS accesses data in your Cloud storage account using credentials you configure when setting up your QDS account. In addition, QDS accesses data in the following ways:

  • For Hive queries, Pig scripts, Hadoop jobs, and Presto queries, QDS runs a Hadoop cluster on instances that Qubole rents for you. The Hadoop cluster reads, processes data, and writes the results back to your storage buckets.
  • When you browse or download results from Qubole’s website (UI or the API), Qubole servers read the results from your object store and provide them to you.
  • When you run data import or export commands, a Qubole server transfers the data.