Spark Jobs

The Spark Jobs page provides a Sankey diagram with jobs by users and by queue. The page also provides detailed information about Spark jobs categorized by name of the job, users running the job, queue in which the job is run, status of the job, and other criteria.

Go to Spark > Jobs to view the Spark Jobs screen.

The default time is Last 24 hrs. To change the timeline, click the down arrow in the time selection menu. The default grouping is Queue. To change the grouping, click the down arrow in the group selection menu.

Searching for Spark Jobs

You can search for Spark jobs using the Search bar. The search criteria includes:

  • user
  • name of the job
  • the current status of the job
  • the queue in which the job is being run

To view all the jobs, sorted by start time, select Un-group in the grouping menu.

Details of a Spark Job

The Jobs panel displays detailed information about Spark jobs categorized by name of the job, users running the job, queue in which the job is run, status of the job, and other criteria. To view the jobs running in a queue, click the queue name to expand the list of jobs. The jobs are sorted by Start Time.

Spark Jobs List

Select a job to view the details in the Spark Job Details page.