View Command History

Note

Commands older than 6 months from the ODBC, API, and SDK sources are not available for review on Workbench. However, these commands will continue to be archived into your configured cloud storage.

The History tab displays previous commands, logs, and results. Search for previous commands by providing the command ID, command type, status, user, tags, name, and so on. You can re-run previous queries, or schedule them to run later, without edits.

../../_images/history.png

Qubole explicitly indicates commands that are waiting to execute. The queue icon indicates that the command is throttled and provides its position in the queue so that users can distinguish these from commands that are already running. A warning message also appears in the lower right pane under Logs.

Note

To prevent other users from seeing your commands, assign them a policy for Command Resource with only the create permission in Control Panel > Manage Roles. This allows users to create a command but prevents them from seeing other users’ commands. For more information, see Resources, Actions, and What they Mean.

View your Search Filters describes the search experience for text/keywords searches and other search fields.

View your Search Filters

Four filters - Source, Command Type, Command Status, and Cluster Label - are selected by default. The Email field is populated with your email ID automatically.

The Text field provide results in the following ways:

  • From the last 100 commands run by the current user: Default method. If you have provided a Cluster Label or Tag, you must provide the Start Date and End Date (maximum duration between the two dates can be 30 days).

  • From the last 3 months data: This provides a larger set of results and is not enabled by default. To enable it, create a ticket with Qubole Support.

The Search History filter with all its fields is illustrated below.

../../_images/search-filter.png

Search Fields and Supported Values

Search Field

Supported

Supported Keywords

Supported Values

Examples that can be part of Search Strings

Command ID

Yes

id

Full command ID; partial command IDs are not supported. Only one value is supported at a time.

command_id:2024

id:2024

Text

Yes

Free-form text

Free-form text with a blank space and partial tokens are supported.

select from table

Email

Yes

email

“All” or 1 or more email IDs. Multiple comma-separated values are supported.

email:user@qubole.com

Source

Yes

api, ui, template, odbc, scheduled

All values.

source:api, interface:ui

Command Type

Yes

command_type, type (Only one value is supported at a time)

Hive

hive

command_type:hive, type:hive

Spark

spark

command_type:spark, type:spark

Presto

presto

command_type:presto, type:presto

Shell

shell

command_type:shell, type:shell

Hadoop

hadoop

command_type:hadoop, type:hadoop

DB Query

dbquery

command_type:dbquery, type:dbquery

Command Status

Yes

status

All values. Only one value is supported at a time.

status:success, status:failed, status:running, status:cancelled

Cluster label

Yes

cluster_label, cluster

Search by a single cluster label. Case-sensitive.

Only one value is supported at a time.

cluster:default, cluster:hadoop2, cluster_label:hadoop2

Tags

Yes

tags

All values. A comma-separated list of values without a blank space.

tags:database,tables

Start date

Yes

start_date

Date must be in dd/mm/yyyy format. 1 October 2017 must be 01/10/2017

Limited date formats are supported.

start_date:01/10/2017

End date

Yes

end_date

Date must be in dd/mm/yyyy format. 15 October 2017 must be 15/10/2017

Limited date formats are supported.

end_date:15/10/2017

Example Search Strings

Here are a few sample search strings that you can use.

  • Look for all failed Hive queries:

    type:hive status:failed

    Any of the supported keywords and values can be used to specify command type and command status.

  • Look for all successful database queries after Oct 1, 2017:

    status:success type:dbquery start_date:10/01/2017

    Separate different filters using a blank space character.

  • Look for data updates to table TableA :

    insert update tableA

    The results displayed include ALL or AND word combinations in the search string in addition to the search string. For example, while searching insert update tableA, these searches are done and results are combined sequentially:

    1. insert tableA

    2. insert

    3. tableA

    4. tableA insert

  • Look for queries within a specific duration, for example, a month:

    insert start_date:09/01/2017 end_date:10/01/2017

    start_date and end_date can be combined to specify the date range or duration.

In environments where elastic search is enabled, the search duration of the cluster label is 90 days by default. If you want the duration to be more than 90 days, you must enter the Start and End dates. Elastic search is currently only supported on the api.qubole.com and us.qubole.com environments.