Composing a Refresh Table Query (AWS)¶
You can compose a query to refresh Hive tables using the query composer available in the Analyze page. See Refresh Table for more information.
Hadoop-2 and Spark clusters support refresh table queries, and the queries can run without clusters. See Mapping of Cluster and Command Types for more information.
You can configure the Pig version on an Hadoop 2 (Hive) cluster. Pig 0.11 is the default version. Pig 0.15 and Pig 0.17 (beta) are the other supported versions. You can also choose between MapReduce and Tez as the execution engine when you set the Pig 0.17 (beta) version. Pig 0.17 (beta) is only supported with Hive 1.2.0.
Perform the following steps to compose a Refresh Table query:
Using the Supported Keyboard Shortcuts in Analyze describes the supported keyboard shortcuts.
Navigate to the Analyze page and click Compose. Select Refresh Table from the Command Type drop-down list. The query composer for Refresh Table is shown in the following figure.
Select a Hive metastore from the Hive Database drop-down list.
Select the Hive table for which the data must be refreshed from the Hive Table Name drop-down list.
Set the Stablity Interval in minutes (numeric value).
Click Run to execute the query. Click Save if you want to run the same query later (See Workspace for more information on saving queries.)
The query result is displayed in the Results tab and the query logs in the Logs tab. The Logs tab has the Errors and Warnings filter. For more information on how to download command results and logs, see Download Results and Logs from the Analyze UI.