org.apache.hadoop.mapreduce.v2.app.speculate

Class DefaultSpeculator

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator

All Implemented Interfaces:

Closeable, AutoCloseable, Speculator, Service, EventHandler<SpeculatorEvent>

public class DefaultSpeculator
extends AbstractService
implements Speculator

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.mapreduce.v2.app.speculate.Speculator

Speculator.EventType

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

Service.STATE

Constructor Summary

Constructors

Constructor and Description
DefaultSpeculator(Configuration conf, AppContext context)
DefaultSpeculator(Configuration conf, AppContext context, Clock clock)
DefaultSpeculator(Configuration conf, AppContext context, TaskRuntimeEstimator estimator, Clock clock)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	addSpeculativeAttempt(TaskId taskID)
boolean	eventQueueEmpty()
void	handle(SpeculatorEvent event)
void	handleAttempt(TaskAttemptStatusUpdateEvent.TaskAttemptStatus status)
void	scanForSpeculations()
protected void	serviceStart() Actions called during the INITED to STARTED transition.
protected void	serviceStop() Actions called during the transition to the STOPPED state.
protected void	statusUpdate(TaskAttemptStatusUpdateEvent.TaskAttemptStatus reportedStatus, long timestamp) Absorbs one TaskAttemptStatus

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, serviceInit, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

DefaultSpeculator

public DefaultSpeculator(Configuration conf,
                 AppContext context)

DefaultSpeculator

public DefaultSpeculator(Configuration conf,
                 AppContext context,
                 Clock clock)

DefaultSpeculator

public DefaultSpeculator(Configuration conf,
                 AppContext context,
                 TaskRuntimeEstimator estimator,
                 Clock clock)

Method Detail

serviceStart

protected void serviceStart()
                     throws Exception

Description copied from class: AbstractService

Actions called during the INITED to STARTED transition. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.start() prevents re-entrancy.

Overrides:

serviceStart in class AbstractService

Throws:

Exception - if needed -these will be caught, wrapped, and trigger a service stop

serviceStop

protected void serviceStop()
                    throws Exception

Description copied from class: AbstractService

Actions called during the transition to the STOPPED state. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.stop() prevents re-entrancy. Implementations MUST write this to be robust against failures, including checks for null references -and for the first failure to not stop other attempts to shut down parts of the service.

Overrides:

serviceStop in class AbstractService

Throws:

Exception - if needed -these will be caught and logged.

handleAttempt

public void handleAttempt(TaskAttemptStatusUpdateEvent.TaskAttemptStatus status)

Specified by:

handleAttempt in interface Speculator

eventQueueEmpty

public boolean eventQueueEmpty()

scanForSpeculations

public void scanForSpeculations()

statusUpdate

protected void statusUpdate(TaskAttemptStatusUpdateEvent.TaskAttemptStatus reportedStatus,
                long timestamp)

Absorbs one TaskAttemptStatus

Parameters:

reportedStatus - the status report that we got from a task attempt that we want to fold into the speculation data for this job

timestamp - the time this status corresponds to. This matters because statuses contain progress.

addSpeculativeAttempt

protected void addSpeculativeAttempt(TaskId taskID)

handle

public void handle(SpeculatorEvent event)

Specified by:

handle in interface EventHandler<SpeculatorEvent>