org.apache.hadoop.mapreduce.v2.hs

Class CachedHistoryStorage

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage

All Implemented Interfaces:

Closeable, AutoCloseable, HistoryStorage, Service

public class CachedHistoryStorage
extends AbstractService
implements HistoryStorage

Manages an in memory cache of parsed Job History files.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

Service.STATE

Constructor Summary

Constructors

Constructor and Description
CachedHistoryStorage()

Method Summary

Methods

Modifier and Type	Method and Description
Map<JobId,Job>	getAllPartialJobs() Get all of the cached jobs.
Job	getFullJob(JobId jobId) Get a fully parsed job.
static JobsInfo	getPartialJobs(Collection<Job> jobs, Long offset, Long count, String user, String queue, Long sBegin, Long sEnd, Long fBegin, Long fEnd, JobState jobState)
JobsInfo	getPartialJobs(Long offset, Long count, String user, String queue, Long sBegin, Long sEnd, Long fBegin, Long fEnd, JobState jobState) Look for a set of partial jobs.
void	serviceInit(Configuration conf) All initialization code needed by a service.
void	setHistoryFileManager(HistoryFileManager hsManager) Give the Storage a reference to a class that can be used to interact with history files.

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, serviceStart, serviceStop, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

CachedHistoryStorage

public CachedHistoryStorage()

Method Detail

setHistoryFileManager

public void setHistoryFileManager(HistoryFileManager hsManager)

Description copied from interface: HistoryStorage

Give the Storage a reference to a class that can be used to interact with history files.

Specified by:

setHistoryFileManager in interface HistoryStorage

Parameters:

hsManager - the class that is used to interact with history files.

serviceInit

public void serviceInit(Configuration conf)
                 throws Exception

Description copied from class: AbstractService

All initialization code needed by a service. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.init(Configuration) prevents re-entrancy. The base implementation checks to see if the subclass has created a new configuration instance, and if so, updates the base class value

Overrides:

serviceInit in class AbstractService

Parameters:

conf - configuration

Throws:

Exception - on a failure -these will be caught, possibly wrapped, and wil; trigger a service stop

getFullJob

public Job getFullJob(JobId jobId)

Description copied from interface: HistoryStorage

Get a fully parsed job.

Specified by:

getFullJob in interface HistoryStorage

Parameters:

jobId - the id of the job

Returns:

the job, or null if it is not found.

getAllPartialJobs

public Map<JobId,Job> getAllPartialJobs()

Description copied from interface: HistoryStorage

Get all of the cached jobs. This only returns partial jobs and is here for legacy reasons.

Specified by:

getAllPartialJobs in interface HistoryStorage

Returns:

all of the cached jobs

getPartialJobs

public JobsInfo getPartialJobs(Long offset,
                      Long count,
                      String user,
                      String queue,
                      Long sBegin,
                      Long sEnd,
                      Long fBegin,
                      Long fEnd,
                      JobState jobState)

Description copied from interface: HistoryStorage

Look for a set of partial jobs.

Specified by:

getPartialJobs in interface HistoryStorage

Parameters:

offset - the offset into the list of jobs.

count - the maximum number of jobs to return.

user - only return jobs for the given user.

queue - only return jobs for in the given queue.

sBegin - only return Jobs that started on or after the given time.

sEnd - only return Jobs that started on or before the given time.

fBegin - only return Jobs that ended on or after the given time.

fEnd - only return Jobs that ended on or before the given time.

jobState - only return Jobs that are in the given job state.

Returns:

The list of filtered jobs.

getPartialJobs

public static JobsInfo getPartialJobs(Collection<Job> jobs,
                      Long offset,
                      Long count,
                      String user,
                      String queue,
                      Long sBegin,
                      Long sEnd,
                      Long fBegin,
                      Long fEnd,
                      JobState jobState)