org.apache.hadoop.hive.ql.exec

Class SMBMapJoinOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<T>

org.apache.hadoop.hive.ql.exec.CommonJoinOperator<T>

org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator<SMBJoinDesc>

org.apache.hadoop.hive.ql.exec.SMBMapJoinOperator

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, Node

public class SMBMapJoinOperator
extends AbstractMapJoinOperator<SMBJoinDesc>
implements java.io.Serializable

Sorted Merge Map Join Operator.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.ProgressCounter, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

emptyList, joinKeys, joinKeysObjectInspectors, joinKeysStandardObjectInspectors, posBigTable

Fields inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

alias, aliasFilterTags, condn, countAfterReport, dummyObj, dummyObjVectors, filterMaps, filterTags, forwardCache, heartbeatInterval, intermediate, joinFilterObjectInspectors, joinFilters, joinValues, joinValuesObjectInspectors, joinValuesStandardObjectInspectors, noOuterJoin, NOTSKIPBIGTABLE, nullsafes, numAliases, offsets, order, rowContainerStandardObjectInspectors, skipVectors, spillTableDesc, totalSz

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

beginTime, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, counterNames, counterNameToEnum, counters, done, fatalErrorCntr, groupKeyObject, id, inputObjInspectors, inputRows, isLogInfoEnabled, numInputRowsCntr, numOutputRowsCntr, operatorId, out, outputObjInspector, outputRows, parentOperators, reporter, state, statsMap, timeTakenCntr, totalTime

Constructor Summary

Constructors

Constructor and Description
SMBMapJoinOperator()
SMBMapJoinOperator(AbstractMapJoinOperator<? extends MapJoinDesc> mapJoinOp)

Method Summary

Modifier and Type	Method and Description
protected boolean	allInitializedParentsAreClosed()
void	cleanUpInputFileChangedOp()
void	closeOp(boolean abort) All done.
java.lang.String	getName() Implements the getName function for the Node Interface.
static java.lang.String	getOperatorName()
OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
void	initializeLocalWork(Configuration hconf)
void	initializeMapredLocalWork(MapJoinDesc mjConf, Configuration hconf, MapredLocalWork localWork, org.apache.commons.logging.Log l4j)
protected void	initializeOp(Configuration hconf) Operator specific initialization.
boolean	isConvertedAutomaticallySMBJoin()
boolean	opAllowedConvertMapJoin()
void	processOp(java.lang.Object row, int tag) Process the row.
void	setConvertedAutomaticallySMBJoin(boolean convertedAutomaticallySMBJoin)

Methods inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

fatalErrorMessage, hasAnyNulls, hasAnyNulls, hasAnyNulls

Methods inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

checkAndGenObject, endGroup, getFilteredValue, getFilterTag, getJoinOutputObjectInspector, getNextSize, getPosToAliasMap, hasFilter, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, reportProgress, setPosToAliasMap, startGroup

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

acceptLimitPushdown, areAllParentsInitialized, assignCounterNameToEnum, augmentPlan, checkFatalErrors, cleanUpInputFileChanged, clone, close, columnNamesRowResolvedCanBeObtained, dump, dump, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getCounterNames, getCounterNameToEnum, getCounters, getDone, getExecContext, getGroupKeyObject, getIdentifier, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getParentOperators, getSchema, getStats, getWrappedCounterName, incrCounter, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeCounters, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedBeforeSortMergeJoin, passExecContext, preorderMap, process, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetLastEnumUsed, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setCounterNames, setCounterNameToEnum, setDone, setExecContext, setGroupKeyObject, setId, setInputObjInspectors, setOperatorId, setOutputCollector, setParentOperators, setReporter, setSchema, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString, updateCounters

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

SMBMapJoinOperator

public SMBMapJoinOperator()

SMBMapJoinOperator

public SMBMapJoinOperator(AbstractMapJoinOperator<? extends MapJoinDesc> mapJoinOp)

Method Detail

initializeOp

protected void initializeOp(Configuration hconf)
                     throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class AbstractMapJoinOperator<SMBJoinDesc>

Throws:

HiveException

initializeLocalWork

public void initializeLocalWork(Configuration hconf)
                         throws HiveException

Overrides:

initializeLocalWork in class Operator<SMBJoinDesc>

Throws:

HiveException

initializeMapredLocalWork

public void initializeMapredLocalWork(MapJoinDesc mjConf,
                                      Configuration hconf,
                                      MapredLocalWork localWork,
                                      org.apache.commons.logging.Log l4j)
                               throws HiveException

Throws:

HiveException

cleanUpInputFileChangedOp

public void cleanUpInputFileChangedOp()
                               throws HiveException

Overrides:

cleanUpInputFileChangedOp in class Operator<SMBJoinDesc>

Throws:

HiveException

processOp

public void processOp(java.lang.Object row,
                      int tag)
               throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

processOp in class Operator<SMBJoinDesc>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

closeOp

public void closeOp(boolean abort)
             throws HiveException

Description copied from class: CommonJoinOperator

All done.

Overrides:

closeOp in class CommonJoinOperator<SMBJoinDesc>

Throws:

HiveException

allInitializedParentsAreClosed

protected boolean allInitializedParentsAreClosed()

Overrides:

allInitializedParentsAreClosed in class Operator<SMBJoinDesc>

getName

public java.lang.String getName()

Implements the getName function for the Node Interface.

Specified by:

getName in interface Node

Overrides:

getName in class CommonJoinOperator<SMBJoinDesc>

Returns:

the name of the operator

getOperatorName

public static java.lang.String getOperatorName()

getType

public OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Overrides:

getType in class AbstractMapJoinOperator<SMBJoinDesc>

Returns:

OperatorType.*

isConvertedAutomaticallySMBJoin

public boolean isConvertedAutomaticallySMBJoin()

setConvertedAutomaticallySMBJoin

public void setConvertedAutomaticallySMBJoin(boolean convertedAutomaticallySMBJoin)

opAllowedConvertMapJoin

public boolean opAllowedConvertMapJoin()

Overrides:

opAllowedConvertMapJoin in class Operator<SMBJoinDesc>