org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair

Class FSSchedulerApp

java.lang.Object

org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplication

org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerApp

@InterfaceAudience.Private
@InterfaceStability.Unstable
public class FSSchedulerApp
extends SchedulerApplication

Constructor Summary

Constructors

Constructor and Description
FSSchedulerApp(ApplicationAttemptId applicationAttemptId, String user, Queue queue, ActiveUsersManager activeUsersManager, RMContext rmContext)

Method Summary

Methods

Modifier and Type	Method and Description
void	addPreemption(RMContainer container, long time)
void	addSchedulingOpportunity(Priority priority)
RMContainer	allocate(NodeType type, FSSchedulerNode node, Priority priority, ResourceRequest request, Container container)
void	containerCompleted(RMContainer rmContainer, ContainerStatus containerStatus, RMContainerEventType event)
void	containerLaunchedOnNode(ContainerId containerId, NodeId nodeId)
NodeType	getAllowedLocalityLevel(Priority priority, int numNodes, double nodeLocalityThreshold, double rackLocalityThreshold) Return the level at which we are allowed to schedule containers, given the current size of the cluster and thresholds indicating how many nodes to fail at (as a fraction of cluster size) before relaxing scheduling constraints.
ApplicationAttemptId	getApplicationAttemptId() Get ApplicationAttemptId of the application master.
ApplicationId	getApplicationId()
AppSchedulable	getAppSchedulable()
Long	getContainerPreemptionTime(RMContainer container)
Resource	getCurrentConsumption()
Resource	getCurrentReservation() Get total current reservations.
Resource	getHeadroom() Get available headroom in terms of resources for the application's user.
Collection<RMContainer>	getLiveContainers() Get the list of live containers
float	getLocalityWaitFactor(Priority priority, int clusterNodes)
int	getNewContainerId()
int	getNumReservedContainers(Priority priority)
Set<RMContainer>	getPreemptionContainers()
Collection<Priority>	getPriorities()
Queue	getQueue()
String	getQueueName()
int	getReReservations(Priority priority)
List<RMContainer>	getReservedContainers() Get the list of reserved containers
Resource	getResource(Priority priority)
ResourceRequest	getResourceRequest(Priority priority, String nodeAddress)
Map<String,ResourceRequest>	getResourceRequests(Priority priority)
RMContainer	getRMContainer(ContainerId id)
int	getSchedulingOpportunities(Priority priority) Return the number of times the application has been given an opportunity to schedule a task at the given priority since the last time it successfully did so.
int	getTotalRequiredResources(Priority priority)
String	getUser()
boolean	isPending() Is this application pending?
boolean	isReserved(FSSchedulerNode node, Priority priority) Has the application reserved the given node at the given priority?
List<Container>	pullNewlyAllocatedContainers()
RMContainer	reserve(FSSchedulerNode node, Priority priority, RMContainer rmContainer, Container container)
void	resetAllowedLocalityLevel(Priority priority, NodeType level) Should be called when the scheduler assigns a container at a higher degree of locality than the current threshold.
void	resetSchedulingOpportunities(Priority priority) Should be called when an application has successfully scheduled a container, or when the scheduling locality threshold is relaxed.
void	setAppSchedulable(AppSchedulable appSchedulable)
void	setHeadroom(Resource globalLimit)
void	showRequests()
void	stop(RMAppAttemptState rmAppAttemptFinalState)
void	unreserve(FSSchedulerNode node, Priority priority)
void	updateResourceRequests(List<ResourceRequest> requests)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FSSchedulerApp

public FSSchedulerApp(ApplicationAttemptId applicationAttemptId,
              String user,
              Queue queue,
              ActiveUsersManager activeUsersManager,
              RMContext rmContext)

Method Detail

getApplicationId

public ApplicationId getApplicationId()

getApplicationAttemptId

public ApplicationAttemptId getApplicationAttemptId()

Description copied from class: SchedulerApplication

Get ApplicationAttemptId of the application master.

Specified by:

getApplicationAttemptId in class SchedulerApplication

Returns:

ApplicationAttemptId of the application master

setAppSchedulable

public void setAppSchedulable(AppSchedulable appSchedulable)

getAppSchedulable

public AppSchedulable getAppSchedulable()

getUser

public String getUser()

updateResourceRequests

public void updateResourceRequests(List<ResourceRequest> requests)

getResourceRequests

public Map<String,ResourceRequest> getResourceRequests(Priority priority)

getNewContainerId

public int getNewContainerId()

getPriorities

public Collection<Priority> getPriorities()

getResourceRequest

public ResourceRequest getResourceRequest(Priority priority,
                                 String nodeAddress)

getTotalRequiredResources

public int getTotalRequiredResources(Priority priority)

getResource

public Resource getResource(Priority priority)

isPending

public boolean isPending()

Is this application pending?

Specified by:

isPending in class SchedulerApplication

Returns:

true if it is else false.

getQueueName

public String getQueueName()

getLiveContainers

public Collection<RMContainer> getLiveContainers()

Get the list of live containers

Specified by:

getLiveContainers in class SchedulerApplication

Returns:

All of the live containers

stop

public void stop(RMAppAttemptState rmAppAttemptFinalState)

containerLaunchedOnNode

public void containerLaunchedOnNode(ContainerId containerId,
                           NodeId nodeId)

containerCompleted

public void containerCompleted(RMContainer rmContainer,
                      ContainerStatus containerStatus,
                      RMContainerEventType event)

pullNewlyAllocatedContainers

public List<Container> pullNewlyAllocatedContainers()

getCurrentConsumption

public Resource getCurrentConsumption()

showRequests

public void showRequests()

getRMContainer

public RMContainer getRMContainer(ContainerId id)

addSchedulingOpportunity

public void addSchedulingOpportunity(Priority priority)

getSchedulingOpportunities

public int getSchedulingOpportunities(Priority priority)

Return the number of times the application has been given an opportunity to schedule a task at the given priority since the last time it successfully did so.

getReReservations

public int getReReservations(Priority priority)

getNumReservedContainers

public int getNumReservedContainers(Priority priority)

getCurrentReservation

public Resource getCurrentReservation()

Get total current reservations. Used only by unit tests

Returns:

total current reservations

reserve

public RMContainer reserve(FSSchedulerNode node,
                  Priority priority,
                  RMContainer rmContainer,
                  Container container)

unreserve

public void unreserve(FSSchedulerNode node,
             Priority priority)

isReserved

public boolean isReserved(FSSchedulerNode node,
                 Priority priority)

Has the application reserved the given node at the given priority?

Parameters:

node - node to be checked

priority - priority of reserved container

Returns:

true is reserved, false if not

getLocalityWaitFactor

public float getLocalityWaitFactor(Priority priority,
                          int clusterNodes)

getReservedContainers

public List<RMContainer> getReservedContainers()

Get the list of reserved containers

Specified by:

getReservedContainers in class SchedulerApplication

Returns:

All of the reserved containers.

setHeadroom

public void setHeadroom(Resource globalLimit)

getHeadroom

public Resource getHeadroom()

Get available headroom in terms of resources for the application's user.

Returns:

available resource headroom

getQueue

public Queue getQueue()

resetSchedulingOpportunities

public void resetSchedulingOpportunities(Priority priority)

Should be called when an application has successfully scheduled a container, or when the scheduling locality threshold is relaxed. Reset various internal counters which affect delay scheduling

Parameters:

priority - The priority of the container scheduled.

getAllowedLocalityLevel

public NodeType getAllowedLocalityLevel(Priority priority,
                               int numNodes,
                               double nodeLocalityThreshold,
                               double rackLocalityThreshold)

Return the level at which we are allowed to schedule containers, given the current size of the cluster and thresholds indicating how many nodes to fail at (as a fraction of cluster size) before relaxing scheduling constraints.

allocate

public RMContainer allocate(NodeType type,
                   FSSchedulerNode node,
                   Priority priority,
                   ResourceRequest request,
                   Container container)

resetAllowedLocalityLevel

public void resetAllowedLocalityLevel(Priority priority,
                             NodeType level)

Should be called when the scheduler assigns a container at a higher degree of locality than the current threshold. Reset the allowed locality level to a higher degree of locality.

addPreemption

public void addPreemption(RMContainer container,
                 long time)

getContainerPreemptionTime

public Long getContainerPreemptionTime(RMContainer container)

getPreemptionContainers

public Set<RMContainer> getPreemptionContainers()