org.apache.hadoop.yarn.server.nodemanager.containermanager

Class ContainerManagerImpl

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.service.CompositeService

org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl

All Implemented Interfaces:

Closeable, AutoCloseable, Service, ServiceStateChangeListener, ContainerManagementProtocol, EventHandler<ContainerManagerEvent>

public class ContainerManagerImpl
extends CompositeService
implements ServiceStateChangeListener, ContainerManagementProtocol, EventHandler<ContainerManagerEvent>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.service.CompositeService

CompositeService.CompositeServiceShutdownHook

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

Service.STATE

Field Summary

Fields

Modifier and Type	Field and Description
protected LocalDirsHandlerService	dirsHandler
protected AsyncDispatcher	dispatcher

Fields inherited from class org.apache.hadoop.service.CompositeService

STOP_ONLY_STARTED_SERVICES

Constructor Summary

Constructors

Constructor and Description
ContainerManagerImpl(Context context, ContainerExecutor exec, DeletionService deletionContext, NodeStatusUpdater nodeStatusUpdater, NodeManagerMetrics metrics, ApplicationACLsManager aclsManager, LocalDirsHandlerService dirsHandler)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	authorizeGetAndStopContainerRequest(ContainerId containerId, Container container, boolean stopRequest, NMTokenIdentifier identifier)
protected void	authorizeStartRequest(NMTokenIdentifier nmTokenIdentifier, ContainerTokenIdentifier containerTokenIdentifier)
protected void	authorizeUser(UserGroupInformation remoteUgi, NMTokenIdentifier nmTokenIdentifier)
void	cleanUpApplicationsOnNMShutDown()
void	cleanupContainersOnNMResync()
protected ContainersLauncher	createContainersLauncher(Context context, ContainerExecutor exec)
protected LogHandler	createLogHandler(Configuration conf, Context context, DeletionService deletionService)
protected ResourceLocalizationService	createResourceLocalizationService(ContainerExecutor exec, DeletionService deletionContext)
Map<String,ByteBuffer>	getAuxServiceMetaData()
boolean	getBlockNewContainerRequestsStatus()
ContainersMonitor	getContainersMonitor()
GetContainerStatusesResponse	getContainerStatuses(GetContainerStatusesRequest request) Get a list of container statuses running on this NodeManager
Context	getContext()
protected UserGroupInformation	getRemoteUgi()
void	handle(ContainerManagerEvent event)
protected NMTokenIdentifier	selectNMTokenIdentifier(UserGroupInformation remoteUgi)
void	serviceInit(Configuration conf) All initialization code needed by a service.
protected void	serviceStart() Actions called during the INITED to STARTED transition.
void	serviceStop() Actions called during the transition to the STOPPED state.
void	setBlockNewContainerRequests(boolean blockNewContainerRequests)
StartContainersResponse	startContainers(StartContainersRequest requests) Start a list of containers on this NodeManager.
void	stateChanged(Service service) Callback to notify of a state change.
StopContainersResponse	stopContainers(StopContainersRequest requests) Stop a list of containers running on this NodeManager.
protected void	updateNMTokenIdentifier(NMTokenIdentifier nmTokenIdentifier)
protected ContainerTokenIdentifier	verifyAndGetContainerTokenIdentifier(Token token, ContainerTokenIdentifier containerTokenIdentifier)

Methods inherited from class org.apache.hadoop.service.CompositeService

addIfService, addService, getServices, removeService

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

dirsHandler

protected LocalDirsHandlerService dirsHandler

dispatcher

protected final AsyncDispatcher dispatcher

Constructor Detail

ContainerManagerImpl

public ContainerManagerImpl(Context context,
                    ContainerExecutor exec,
                    DeletionService deletionContext,
                    NodeStatusUpdater nodeStatusUpdater,
                    NodeManagerMetrics metrics,
                    ApplicationACLsManager aclsManager,
                    LocalDirsHandlerService dirsHandler)

Method Detail

serviceInit

public void serviceInit(Configuration conf)
                 throws Exception

Description copied from class: AbstractService

All initialization code needed by a service. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.init(Configuration) prevents re-entrancy. The base implementation checks to see if the subclass has created a new configuration instance, and if so, updates the base class value

Overrides:

serviceInit in class CompositeService

Parameters:

conf - configuration

Throws:

Exception - on a failure -these will be caught, possibly wrapped, and wil; trigger a service stop

createLogHandler

protected LogHandler createLogHandler(Configuration conf,
                          Context context,
                          DeletionService deletionService)

getContainersMonitor

public ContainersMonitor getContainersMonitor()

createResourceLocalizationService

protected ResourceLocalizationService createResourceLocalizationService(ContainerExecutor exec,
                                                            DeletionService deletionContext)

createContainersLauncher

protected ContainersLauncher createContainersLauncher(Context context,
                                          ContainerExecutor exec)

serviceStart

protected void serviceStart()
                     throws Exception

Description copied from class: AbstractService

Actions called during the INITED to STARTED transition. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.start() prevents re-entrancy.

Overrides:

serviceStart in class CompositeService

Throws:

Exception - if needed -these will be caught, wrapped, and trigger a service stop

serviceStop

public void serviceStop()
                 throws Exception

Description copied from class: AbstractService

Actions called during the transition to the STOPPED state. This method will only ever be called once during the lifecycle of a specific service instance. Implementations do not need to be synchronized as the logic in AbstractService.stop() prevents re-entrancy. Implementations MUST write this to be robust against failures, including checks for null references -and for the first failure to not stop other attempts to shut down parts of the service.

Overrides:

serviceStop in class CompositeService

Throws:

Exception - if needed -these will be caught and logged.

cleanUpApplicationsOnNMShutDown

public void cleanUpApplicationsOnNMShutDown()

cleanupContainersOnNMResync

public void cleanupContainersOnNMResync()

getRemoteUgi

protected UserGroupInformation getRemoteUgi()
                                     throws YarnException

Throws:

YarnException

selectNMTokenIdentifier

@InterfaceAudience.Private
protected NMTokenIdentifier selectNMTokenIdentifier(UserGroupInformation remoteUgi)

authorizeUser

protected void authorizeUser(UserGroupInformation remoteUgi,
                 NMTokenIdentifier nmTokenIdentifier)
                      throws YarnException

Throws:

YarnException

authorizeStartRequest

@InterfaceAudience.Private
protected void authorizeStartRequest(NMTokenIdentifier nmTokenIdentifier,
                                                   ContainerTokenIdentifier containerTokenIdentifier)
                              throws YarnException

Parameters:

containerTokenIdentifier - of the container to be started

Throws:

YarnException

startContainers

public StartContainersResponse startContainers(StartContainersRequest requests)
                                        throws YarnException,
                                               IOException

Start a list of containers on this NodeManager.

Specified by:

startContainers in interface ContainerManagementProtocol

Parameters:

requests - request to start a list of containers

Returns:

response including conatinerIds of all successfully launched containers, a containerId-to-exception map for failed requests and a allServicesMetaData map.

Throws:

YarnException

NMNotYetReadyException - This exception is thrown when NM starts from scratch but has not yet connected with RM.

IOException

verifyAndGetContainerTokenIdentifier

protected ContainerTokenIdentifier verifyAndGetContainerTokenIdentifier(Token token,
                                                            ContainerTokenIdentifier containerTokenIdentifier)
                                                                 throws YarnException,
                                                                        SecretManager.InvalidToken

Throws:

YarnException

SecretManager.InvalidToken

updateNMTokenIdentifier

@InterfaceAudience.Private
protected void updateNMTokenIdentifier(NMTokenIdentifier nmTokenIdentifier)
                                throws SecretManager.InvalidToken

Throws:

SecretManager.InvalidToken

stopContainers

public StopContainersResponse stopContainers(StopContainersRequest requests)
                                      throws YarnException,
                                             IOException

Stop a list of containers running on this NodeManager.

Specified by:

stopContainers in interface ContainerManagementProtocol

Parameters:

requests - request to stop a list of containers

Returns:

response which includes a list of containerIds of successfully stopped containers, a containerId-to-exception map for failed requests.

Throws:

YarnException

IOException

getContainerStatuses

public GetContainerStatusesResponse getContainerStatuses(GetContainerStatusesRequest request)
                                                  throws YarnException,
                                                         IOException

Get a list of container statuses running on this NodeManager

Specified by:

getContainerStatuses in interface ContainerManagementProtocol

Parameters:

request - request to get ContainerStatuses of containers with the specified ContainerIds

Returns:

response containing the list of ContainerStatus of the successfully queried containers and a containerId-to-exception map for failed requests.

Throws:

YarnException

IOException

authorizeGetAndStopContainerRequest

@InterfaceAudience.Private
protected void authorizeGetAndStopContainerRequest(ContainerId containerId,
                                                                 Container container,
                                                                 boolean stopRequest,
                                                                 NMTokenIdentifier identifier)
                                            throws YarnException

Throws:

YarnException

handle

public void handle(ContainerManagerEvent event)

Specified by:

handle in interface EventHandler<ContainerManagerEvent>

setBlockNewContainerRequests

public void setBlockNewContainerRequests(boolean blockNewContainerRequests)

getBlockNewContainerRequestsStatus

@InterfaceAudience.Private
public boolean getBlockNewContainerRequestsStatus()

stateChanged

public void stateChanged(Service service)

Description copied from interface: ServiceStateChangeListener

Callback to notify of a state change. The service will already have changed state before this callback is invoked. This operation is invoked on the thread that initiated the state change, while the service itself in in a sychronized section.

1. Any long-lived operation here will prevent the service state change from completing in a timely manner.
2. If another thread is somehow invoked from the listener, and that thread invokes the methods of the service (including subclass-specific methods), there is a risk of a deadlock.

Specified by:

stateChanged in interface ServiceStateChangeListener

Parameters:

service - the service that has changed.

getContext

public Context getContext()

getAuxServiceMetaData

public Map<String,ByteBuffer> getAuxServiceMetaData()