Hive ACID Data Source for Apache Spark¶
Qubole offers a data source on top of Spark Data source V1 APIs, which provides Spark support for Hive ACID transactions.
Hive ACID Data Source for Apache Spark is a Beta feature, and is not enabled for all users by default. Create a ticket with Qubole Support to enable this feature on the QDS account.
With this data source, you can work with Hive ACID V2 tables, both Full ACID tables as well as Insert-Only tables. For details about the supported operations, see the Supported operations.
The following topics provides the information about the configuration and usage.