org.apache.hadoop.mapreduce.v2.hs

Class JobHistory

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.mapreduce.v2.hs.JobHistory

All Implemented Interfaces:

Closeable, AutoCloseable, AppContext, HistoryContext, Service

public class JobHistory
extends AbstractService
implements HistoryContext

Loads and manages the Job history cache.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

Service.STATE

Field Summary

Fields

Modifier and Type	Field and Description
static Pattern	CONF_FILENAME_REGEX
static String	OLD_SUFFIX

Constructor Summary

Constructors

Constructor and Description
JobHistory()

Method Summary

Methods

Modifier and Type	Method and Description
Map<JobId,Job>	getAllJobs()
Map<JobId,Job>	getAllJobs(ApplicationId appID)
ApplicationAttemptId	getApplicationAttemptId()
ApplicationId	getApplicationID()
String	getApplicationName()
Set<String>	getBlacklistedNodes()
ClientToAMTokenSecretManager	getClientToAMTokenSecretManager()
Clock	getClock()
ClusterInfo	getClusterInfo()
EventHandler	getEventHandler()
Job	getJob(JobId jobId)
JobsInfo	getPartialJobs(Long offset, Long count, String user, String queue, Long sBegin, Long sEnd, Long fBegin, Long fEnd, JobState jobState) Look for a set of partial jobs.
CharSequence	getUser()
boolean	hasSuccessfullyUnregistered()
boolean	isLastAMRetry()
protected void	serviceInit(Configuration conf) All initialization code needed by a service.
protected void	serviceStart() Actions called during the INITED to STARTED transition.
protected void	serviceStop() Actions called during the transition to the STOPPED state.

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.mapreduce.v2.app.AppContext

getStartTime

Field Detail

CONF_FILENAME_REGEX

public static final Pattern CONF_FILENAME_REGEX

OLD_SUFFIX

public static final String OLD_SUFFIX

See Also:

Constant Field Values

Constructor Detail

JobHistory

public JobHistory()

Method Detail

serviceInit

protected void serviceInit(Configuration conf)
                    throws Exception

Description copied from class: AbstractService

All initialization code needed by a service. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.init(Configuration) prevents re-entrancy. The base implementation checks to see if the subclass has created a new configuration instance, and if so, updates the base class value

Overrides:

serviceInit in class AbstractService

Parameters:

conf - configuration

Throws:

Exception - on a failure -these will be caught, possibly wrapped, and wil; trigger a service stop

serviceStart

protected void serviceStart()
                     throws Exception

Description copied from class: AbstractService

Actions called during the INITED to STARTED transition. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.start() prevents re-entrancy.

Overrides:

serviceStart in class AbstractService

Throws:

Exception - if needed -these will be caught, wrapped, and trigger a service stop

serviceStop

protected void serviceStop()
                    throws Exception

Description copied from class: AbstractService

Actions called during the transition to the STOPPED state. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.stop() prevents re-entrancy. Implementations MUST write this to be robust against failures, including checks for null references -and for the first failure to not stop other attempts to shut down parts of the service.

Overrides:

serviceStop in class AbstractService

Throws:

Exception - if needed -these will be caught and logged.

getApplicationName

public String getApplicationName()

Specified by:

getApplicationName in interface AppContext

getJob

public Job getJob(JobId jobId)

Specified by:

getJob in interface AppContext

getAllJobs

public Map<JobId,Job> getAllJobs(ApplicationId appID)

Specified by:

getAllJobs in interface HistoryContext

getAllJobs

public Map<JobId,Job> getAllJobs()

Specified by:

getAllJobs in interface AppContext

getPartialJobs

public JobsInfo getPartialJobs(Long offset,
                      Long count,
                      String user,
                      String queue,
                      Long sBegin,
                      Long sEnd,
                      Long fBegin,
                      Long fEnd,
                      JobState jobState)

Look for a set of partial jobs.

Specified by:

getPartialJobs in interface HistoryContext

Parameters:

offset - the offset into the list of jobs.

count - the maximum number of jobs to return.

user - only return jobs for the given user.

queue - only return jobs for in the given queue.

sBegin - only return Jobs that started on or after the given time.

sEnd - only return Jobs that started on or before the given time.

fBegin - only return Jobs that ended on or after the given time.

fEnd - only return Jobs that ended on or before the given time.

jobState - only return jobs that are in the give job state.

Returns:

The list of filtered jobs.

getApplicationAttemptId

public ApplicationAttemptId getApplicationAttemptId()

Specified by:

getApplicationAttemptId in interface AppContext

getApplicationID

public ApplicationId getApplicationID()

Specified by:

getApplicationID in interface AppContext

getEventHandler

public EventHandler getEventHandler()

Specified by:

getEventHandler in interface AppContext

getUser

public CharSequence getUser()

Specified by:

getUser in interface AppContext

getClock

public Clock getClock()

Specified by:

getClock in interface AppContext

getClusterInfo

public ClusterInfo getClusterInfo()

Specified by:

getClusterInfo in interface AppContext

getBlacklistedNodes

public Set<String> getBlacklistedNodes()

Specified by:

getBlacklistedNodes in interface AppContext

getClientToAMTokenSecretManager

public ClientToAMTokenSecretManager getClientToAMTokenSecretManager()

Specified by:

getClientToAMTokenSecretManager in interface AppContext

isLastAMRetry

public boolean isLastAMRetry()

Specified by:

isLastAMRetry in interface AppContext

hasSuccessfullyUnregistered

public boolean hasSuccessfullyUnregistered()

Specified by:

hasSuccessfullyUnregistered in interface AppContext