org.apache.hadoop.mapreduce.v2.hs

Class CompletedJob

java.lang.Object

org.apache.hadoop.mapreduce.v2.hs.CompletedJob

All Implemented Interfaces:

Job

public class CompletedJob
extends Object
implements Job

Loads the basic job level data upfront. Data from job history file is loaded lazily.

Constructor Summary

Constructors

Constructor and Description
CompletedJob(Configuration conf, JobId jobId, Path historyFile, boolean loadTasks, String userName, HistoryFileManager.HistoryFileInfo info, JobACLsManager aclsMgr)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	checkAccess(UserGroupInformation callerUGI, JobACL jobOperation)
Counters	getAllCounters() Get all the counters of this job.
List<AMInfo>	getAMInfos()
int	getCompletedMaps()
int	getCompletedReduces()
Path	getConfFile()
List<String>	getDiagnostics()
JobId	getID()
Map<JobACL,AccessControlList>	getJobACLs()
TaskCompletionEvent[]	getMapAttemptCompletionEvents(int startIndex, int maxEvents)
String	getName()
float	getProgress()
String	getQueueName()
JobReport	getReport()
JobState	getState()
Task	getTask(TaskId taskId)
TaskAttemptCompletionEvent[]	getTaskAttemptCompletionEvents(int fromEventId, int maxEvents)
Map<TaskId,Task>	getTasks()
Map<TaskId,Task>	getTasks(TaskType taskType)
int	getTotalMaps()
int	getTotalReduces()
String	getUserName()
boolean	isUber()
Configuration	loadConfFile()
protected void	loadFullHistoryData(boolean loadTasks, Path historyFileAbsolute)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CompletedJob

public CompletedJob(Configuration conf,
            JobId jobId,
            Path historyFile,
            boolean loadTasks,
            String userName,
            HistoryFileManager.HistoryFileInfo info,
            JobACLsManager aclsMgr)
             throws IOException

Throws:

IOException

Method Detail

getCompletedMaps

public int getCompletedMaps()

Specified by:

getCompletedMaps in interface Job

getCompletedReduces

public int getCompletedReduces()

Specified by:

getCompletedReduces in interface Job

getAllCounters

public Counters getAllCounters()

Description copied from interface: Job

Get all the counters of this job. This includes job-counters aggregated together with the counters of each task. This creates a clone of the Counters, so use this judiciously.

Specified by:

getAllCounters in interface Job

Returns:

job-counters and aggregate task-counters

getID

public JobId getID()

Specified by:

getID in interface Job

getReport

public JobReport getReport()

Specified by:

getReport in interface Job

getProgress

public float getProgress()

Specified by:

getProgress in interface Job

getState

public JobState getState()

Specified by:

getState in interface Job

getTask

public Task getTask(TaskId taskId)

Specified by:

getTask in interface Job

getTaskAttemptCompletionEvents

public TaskAttemptCompletionEvent[] getTaskAttemptCompletionEvents(int fromEventId,
                                                          int maxEvents)

Specified by:

getTaskAttemptCompletionEvents in interface Job

getMapAttemptCompletionEvents

public TaskCompletionEvent[] getMapAttemptCompletionEvents(int startIndex,
                                                  int maxEvents)

Specified by:

getMapAttemptCompletionEvents in interface Job

getTasks

public Map<TaskId,Task> getTasks()

Specified by:

getTasks in interface Job

loadFullHistoryData

protected void loadFullHistoryData(boolean loadTasks,
                       Path historyFileAbsolute)
                            throws IOException

Throws:

IOException

getDiagnostics

public List<String> getDiagnostics()

Specified by:

getDiagnostics in interface Job

getName

public String getName()

Specified by:

getName in interface Job

getQueueName

public String getQueueName()

Specified by:

getQueueName in interface Job

getTotalMaps

public int getTotalMaps()

Specified by:

getTotalMaps in interface Job

getTotalReduces

public int getTotalReduces()

Specified by:

getTotalReduces in interface Job

isUber

public boolean isUber()

Specified by:

isUber in interface Job

getTasks

public Map<TaskId,Task> getTasks(TaskType taskType)

Specified by:

getTasks in interface Job

checkAccess

public boolean checkAccess(UserGroupInformation callerUGI,
                  JobACL jobOperation)

Specified by:

checkAccess in interface Job

getJobACLs

public Map<JobACL,AccessControlList> getJobACLs()

Specified by:

getJobACLs in interface Job

Returns:

the ACLs for this job for each type of JobACL given.

getUserName

public String getUserName()

Specified by:

getUserName in interface Job

getConfFile

public Path getConfFile()

Specified by:

getConfFile in interface Job

Returns:

a path to where the config file for this job is located.

loadConfFile

public Configuration loadConfFile()
                           throws IOException

Specified by:

loadConfFile in interface Job

Returns:

a parsed version of the config files pointed to by Job.getConfFile().

Throws:

IOException - on any error trying to load the conf file.

getAMInfos

public List<AMInfo> getAMInfos()

Specified by:

getAMInfos in interface Job

Returns:

information for MR AppMasters (previously failed and current)