Hive on Spark Queries

Click Hive on SparkQueries to view the list of Hive queries. The Queries page consists of a filter panel, a Sankey Diagram, and charts that display information about queries that you can group by Users or Queries. The Sankey diagram displays the flow of jobs from a selected queue to users and to the queries.

note

The default time range is Last 24 hrs. To view statistics from a custom date range, click the icon and select a time frame and timezone of your choice.

The following metrics are displayed for each query group.

MetricDescription
Group NameThe name of the group filtered by User or Queries.
Query CountThe number of queries in the group.
Failed QueriesThe number of queries that failed to execute.
Running QueriesThe number of currently running queries.
Avg MemoryThe average amount of memory consumed by a query group.
Total MemoryThe total memory consumed by a query group.
Avg VCoreThe average number of VCores used by a query group.
Total VCoreThe total number of VCores used by a query group.
Avg DurationThe average time taken to execute queries in a query group.
Total DurationThe total time taken to execute queries in a query group.

The following metrics are displayed for each query.

note

Click a query ID to view more details about the query in the Query Details page.

MetricDescription
IDThe ID of a query.
App IDThe ID of application used in a query.
UserThe user who executed the query.
QueueThe queue that the query belongs to.
DurationThe time taken to execute the query.
StatusThe final state of the query run by the user. The state can be: Failed, Finished, Compiled.
Start TimeThe time at which the query started.
End TimeThe time at which the query completed execution.
HDFS ReadThe amount of HDFS data read.
HDFS WrittenThe amount of HDFS data written to an output file format.
GC TimeTime spent by the JVM in garbage collection while executing a query.
MemoryThe amount of memory consumed in executing the query.
VCoreThe number of VCores used in query processing.
RecommendationsThe number of recommendations given to enhance your query. You can view the recommendations by clicking the query ID against the recommendation you want to view.

Advanced Search Options

The search field in the Tez Queries Page supports Influx-like query statements. For example, if you want to search for a query, use the format parametername:value. However, you need to know the full name of the parameter to be able to use it. For example, the name of the parameter visible in the UI is User. However, internally, the parameter name is effective_user. Hence, if you want to search for queries with User = Mark, you need to type effective_user:Mark.