Qubole Data Service Logo
latest
  • Quick Start Guide
  • Changelog
  • Release Notes
  • ODBC and JDBC Drivers Release Notes
  • User Guide
    • Introduction
    • Using the Qubole Data Service (QDS)
    • Account Settings
    • Creating Notification Channels
    • Data Analytics
    • Command Templates
    • Data Exploration
    • Clusters
    • Engines
    • Data Engineering
      • Airflow
        • Introduction to Airflow in Qubole
        • Setting up a Data Store (AWS)
        • Configuring an Airflow Cluster
        • Uploading and Downloading a DAG on an Airflow Cluster
        • Upgrading Airflow Clusters
        • Registering a DAG on an Airflow Cluster
        • Deleting a DAG on an Airflow Cluster
        • Monitoring an Airflow Cluster
        • Enabling notifications for Airflow
        • Using Default or Custom Failure Handling
        • Understanding the Qubole Operator API
        • Qubole Operator Examples
        • Using the Node Bootstrap on Airflow Clusters (AWS)
        • Experimental APIs
      • Qubole Scheduler
      • Quest
    • Data Science
    • Cloud File Systems
    • Package Management
    • Macros
    • File and Partition Sensors
  • Administration Guide
  • Connectivity Options
  • REST API Reference
  • Troubleshooting Guide
  • Product Security Guide
  • FAQs
  • QDS Alerts and Runbooks
  • Qubole Billing Guide
  • QDS Help Center
  • Providing Feedback
  • Launch Stage and Availability of Features
Qubole Data Service
  • Docs »
  • User Guide »
  • Data Engineering »
  • Airflow
  • Edit on Bitbucket

AirflowΒΆ

Note

See QDS Components: Supported Versions and Cloud Platforms for up-to-date information on Airflow support in QDS. To enable Airflow on Oracle OCI, create a Qubole Support ticket.

This section explains how to deploy and use Airflow. It covers the following topics:

  • Introduction to Airflow in Qubole
  • Setting up a Data Store (AWS)
  • Configuring an Airflow Cluster
  • Uploading and Downloading a DAG on an Airflow Cluster
  • Upgrading Airflow Clusters
  • Registering a DAG on an Airflow Cluster
  • Deleting a DAG on an Airflow Cluster
  • Monitoring an Airflow Cluster
  • Enabling notifications for Airflow
  • Using Default or Custom Failure Handling
  • Understanding the Qubole Operator API
  • Qubole Operator Examples
  • Using the Node Bootstrap on Airflow Clusters (AWS)
  • Experimental APIs

To know more about troubleshooting Airflow related issues, see Troubleshooting Airflow Issues.

Feedback
Next Previous

© Copyright 2019, Qubole.

Read the Docs v: latest
Versions
latest
Downloads
html
epub
On Read the Docs
Project Home
Builds

Free document hosting provided by Read the Docs.