Qubole Scheduler

The QDS scheduler allows you to configure jobs and specify the intervals at which they run, and provides additional capabilities that make it a powerful tool for automating your workflow. Job characteristics you can specify include:

• The job type (Hive Query, Hadoop Job, etc.) and query parameters

• The job start and end date and time, and its time zone and frequency

• Javascript macros to be included

• The Hadoop Fair Scheduler queue (Hadoop 2) to be used

• The number of concurrent jobs to allow

• Hive and AWS S3 dependencies, to ensure that the job runs only when the data it needs is available.

For more information, see the following topics:

• Using the Scheduler User Interface
• Understanding the Qubole Scheduler Concepts
• Viewing a Schedule
• Creating a New Schedule
• Configuring S3/Azure Blob Storage Files Data Dependency
• Configuring Hive Tables Data Dependency
• Managing Scheduler Permissions through the UI
• Editing and Cloning a Schedule
• Hive Datasets as Schedule Dependency
• Macros in Scheduler