org.apache.hadoop.hive.ql.exec.mr

Class MapredLocalTask

java.lang.Object

org.apache.hadoop.hive.ql.exec.Task<MapredLocalWork>

org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask

All Implemented Interfaces:

java.io.Serializable, Node

public class MapredLocalTask
extends Task<MapredLocalWork>
implements java.io.Serializable

MapredLocalTask represents any local work (i.e.: client side work) that hive needs to execute. E.g.: This is used for generating Hashtables for Mapjoins on the client before the Join is executed on the cluster. MapRedLocalTask does not actually execute the work in process, but rather generates a command using ExecDriver. ExecDriver is what will finally drive processing the records.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Task

Task.FeedType

Field Summary

Fields

Modifier and Type	Field and Description
protected HadoopJobExecHelper	jobExecHelper
static org.apache.commons.logging.Log	l4j
static java.lang.management.MemoryMXBean	memoryMXBean

Fields inherited from class org.apache.hadoop.hive.ql.exec.Task

BACKUP_COMMON_JOIN, backupChildrenTasks, backupTask, childTasks, clonedConf, COMMON_JOIN, conf, console, CONVERTED_LOCAL_MAPJOIN, CONVERTED_MAPJOIN, CONVERTED_SORTMERGEJOIN, db, driverContext, feedSubscribers, id, initialized, isdone, jobID, LOCAL_MAPJOIN, MAPJOIN_ONLY_NOBACKUP, NO_TAG, parentTasks, queryPlan, queued, started, taskCounters, taskHandle, taskTag, work

Constructor Summary

Constructors

Constructor and Description
MapredLocalTask()
MapredLocalTask(MapredLocalWork plan, JobConf job, boolean isSilent)

Method Summary

Modifier and Type	Method and Description
int	execute(DriverContext driverContext) This method is overridden in each Task.
int	executeFromChildJVM(DriverContext driverContext)
java.lang.String	getName() Gets the name of the node.
java.util.Collection<Operator<? extends OperatorDesc>>	getTopOperators()
StageType	getType() Should be overridden to return the type of the specific task among the types in StageType.
void	initialize(HiveConf conf, QueryPlan queryPlan, DriverContext driverContext)
boolean	isMapRedLocalTask()
static java.lang.String	now()
boolean	requireLock()
void	shutdown()

Methods inherited from class org.apache.hadoop.hive.ql.exec.Task

addDependentTask, cloneConf, done, executeTask, fetch, getAndInitBackupTask, getBackupChildrenTasks, getBackupTask, getChildren, getChildTasks, getCounters, getDependentTasks, getFeedSubscribers, getId, getInitialized, getJobID, getParentTasks, getQueryPlan, getQueued, getReducer, getResultSchema, getTaskHandle, getTaskTag, getWork, hasReduce, ifRetryCmdWhenFail, isLocalMode, isMapRedTask, isRunnable, pushFeed, receiveFeed, removeDependentTask, removeFromChildrenTasks, setBackupChildrenTasks, setBackupTask, setChildTasks, setDone, setFeedSubscribers, setId, setInitialized, setLocalMode, setParentTasks, setQueryPlan, setQueued, setRetryCmdWhenFail, setStarted, setTaskTag, setWork, started, subscribeFeed

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

jobExecHelper

protected HadoopJobExecHelper jobExecHelper

l4j

public static final transient org.apache.commons.logging.Log l4j

memoryMXBean

public static java.lang.management.MemoryMXBean memoryMXBean

Constructor Detail

MapredLocalTask

public MapredLocalTask()

MapredLocalTask

public MapredLocalTask(MapredLocalWork plan,
                       JobConf job,
                       boolean isSilent)
                throws HiveException

Throws:

HiveException

Method Detail

initialize

public void initialize(HiveConf conf,
                       QueryPlan queryPlan,
                       DriverContext driverContext)

Overrides:

initialize in class Task<MapredLocalWork>

now

public static java.lang.String now()

requireLock

public boolean requireLock()

Overrides:

requireLock in class Task<MapredLocalWork>

execute

public int execute(DriverContext driverContext)

Description copied from class: Task

This method is overridden in each Task. TODO execute should return a TaskHandle.

Specified by:

execute in class Task<MapredLocalWork>

Returns:

status of executing the task

executeFromChildJVM

public int executeFromChildJVM(DriverContext driverContext)

isMapRedLocalTask

public boolean isMapRedLocalTask()

Overrides:

isMapRedLocalTask in class Task<MapredLocalWork>

getTopOperators

public java.util.Collection<Operator<? extends OperatorDesc>> getTopOperators()

Overrides:

getTopOperators in class Task<MapredLocalWork>

getName

public java.lang.String getName()

Description copied from interface: Node

Gets the name of the node. This is used in the rule dispatchers.

Specified by:

getName in interface Node

Returns:

String

getType

public StageType getType()

Description copied from class: Task

Should be overridden to return the type of the specific task among the types in StageType.

Specified by:

getType in class Task<MapredLocalWork>

Returns:

StageType.* or null if not overridden

shutdown

public void shutdown()

Overrides:

shutdown in class Task<MapredLocalWork>