| Modifier and Type | Class and Description |
|---|---|
class |
Configuration
Provides access to configuration parameters.
|
| Modifier and Type | Class and Description |
|---|---|
class |
TaggedMapOutput
This abstract class serves as the base class for the values that
flow from the mappers to the reducers in a data join job.
|
| Modifier and Type | Method and Description |
|---|---|
abstract Writable |
TaggedMapOutput.getData() |
| Modifier and Type | Class and Description |
|---|---|
static class |
BaileyBorweinPlouffe.BbpSplit
Input split for the
BaileyBorweinPlouffe.BbpInputFormat. |
static class |
MultiFileWordCount.WordOffset
This record keeps <filename,offset> pairs.
|
static class |
SecondarySort.IntPair
Define a pair of integers that are writable.
|
| Modifier and Type | Class and Description |
|---|---|
static class |
DistSum.Machine.SummationSplit
Split for the summations
|
class |
SummationWritable
A Writable class for Summation
|
class |
TaskResult
A class for map task results or reduce task results.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ContentSummary
Store the summary of a content (a directory or a file).
|
class |
FileChecksum
An abstract class representing file checksums for files.
|
class |
FileStatus
Interface that represents the client side information for a file.
|
class |
FsServerDefaults
Provides server default configuration values to clients.
|
class |
FsStatus
This class is used to represent the capacity, free and used space on a
FileSystem. |
class |
LocatedFileStatus
This class defines a FileStatus that includes a file's block locations.
|
class |
MD5MD5CRC32CastagnoliFileChecksum
For CRC32 with the Castagnoli polynomial
|
class |
MD5MD5CRC32FileChecksum
MD5 of MD5 of CRC32.
|
class |
MD5MD5CRC32GzipFileChecksum
For CRC32 with the Gzip polynomial
|
| Modifier and Type | Class and Description |
|---|---|
class |
FsPermission
A class for file/directory permissions.
|
class |
PermissionStatus
Store permission related information.
|
| Modifier and Type | Class and Description |
|---|---|
class |
DeprecatedUTF8
A simple wrapper around
UTF8. |
static class |
DistributedFileSystem.DiskStatus
Deprecated.
Use
FsStatus instead |
class |
HdfsConfiguration
Adds deprecated keys into the configuration.
|
| Modifier and Type | Class and Description |
|---|---|
class |
Block
A Block is a Hadoop FS primitive, identified by a
long.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BlockKey
Key used for generating and verifying block tokens
|
class |
BlockTokenIdentifier |
class |
ExportedBlockKeys
Object for passing block keys
|
| Modifier and Type | Class and Description |
|---|---|
class |
DelegationTokenIdentifier
A delegation token identifier that is specific to HDFS.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BlockInfo
BlockInfo class maintains for a given block
the
INodeFile it is part of and datanodes where the replicas of
the block are stored. |
class |
BlockInfoUnderConstruction
Represents a block that is currently being constructed.
This is usually the last block of a file opened for write or append. |
| Modifier and Type | Class and Description |
|---|---|
class |
FinalizedReplica
This class describes a replica that has been finalized.
|
class |
ReplicaBeingWritten
This class represents replicas being written.
|
class |
ReplicaInfo
This class is used by datanodes to maintain meta data of its replicas.
|
class |
ReplicaInPipeline
This class defines a replica in a pipeline, which
includes a persistent replica being written to by a dfs client or
a temporary replica being replicated by a source datanode or
being copied for the balancing purpose.
|
class |
ReplicaUnderRecovery
This class represents replicas that are under block recovery
It has a recovery id that is equal to the generation stamp
that the replica will be bumped to after recovery
The recovery id is used to handle multiple concurrent block recoveries.
|
class |
ReplicaWaitingToBeRecovered
This class represents a replica that is waiting to be recovered.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ReplicaRecoveryInfo
Replica recovery information.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
WritableComparable<T>
A
Writable which is also Comparable. |
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractMapWritable
Abstract base class for MapWritable and SortedMapWritable
Unlike org.apache.nutch.crawl.MapWritable, this class allows creation of
MapWritable<Writable, MapWritable> so the CLASS_TO_ID and ID_TO_CLASS
maps travel with the class instead of being static.
|
class |
ArrayPrimitiveWritable
This is a wrapper class.
|
class |
ArrayWritable
A Writable for arrays containing instances of a class.
|
class |
BooleanWritable
A WritableComparable for booleans.
|
class |
BytesWritable
A byte sequence that is usable as a key or value.
|
class |
ByteWritable
A WritableComparable for a single byte.
|
class |
CompressedWritable
A base-class for Writables which store themselves compressed and lazily
inflate on field access.
|
class |
DoubleWritable
Writable for Double values.
|
class |
EnumSetWritable<E extends Enum<E>>
A Writable wrapper for EnumSet.
|
class |
FloatWritable
A WritableComparable for floats.
|
class |
GenericWritable
A wrapper for Writable instances.
|
class |
IntWritable
A WritableComparable for ints.
|
class |
LongWritable
A WritableComparable for longs.
|
class |
MapWritable
A Writable Map.
|
class |
MD5Hash
A Writable for MD5 hash values.
|
class |
NullWritable
Singleton Writable with no data.
|
class |
ObjectWritable
A polymorphic Writable that writes an instance with it's class name.
|
static class |
SequenceFile.Metadata
The class encapsulating with the metadata of a file.
|
class |
ShortWritable
A WritableComparable for shorts.
|
class |
SortedMapWritable
A Writable SortedMap.
|
class |
Text
This class stores text using standard UTF8 encoding.
|
class |
TwoDArrayWritable
A Writable for 2D arrays containing a matrix of instances of a class.
|
class |
UTF8
Deprecated.
replaced by Text
|
class |
VersionedWritable
A base class for Writables that provides version checking.
|
class |
VIntWritable
A WritableComparable for integer values stored in variable-length format.
|
class |
VLongWritable
A WritableComparable for longs in a variable-length format.
|
| Modifier and Type | Method and Description |
|---|---|
static <T extends Writable> |
WritableUtils.clone(T orig,
Configuration conf)
Make a copy of a writable object using serialization to a buffer.
|
| Modifier and Type | Method and Description |
|---|---|
Writable[] |
ArrayWritable.get() |
Writable |
GenericWritable.get()
Return the wrapped instance.
|
Writable[][] |
TwoDArrayWritable.get() |
Writable |
ArrayFile.Reader.get(long n,
Writable value)
Return the
nth value in the file. |
Writable |
SortedMapWritable.get(Object key) |
Writable |
MapWritable.get(Object key) |
Writable |
BloomMapFile.Reader.get(WritableComparable key,
Writable val)
Fast version of the
MapFile.Reader.get(WritableComparable, Writable) method. |
Writable |
MapFile.Reader.get(WritableComparable key,
Writable val)
Return the value for the named key, or null if none exists.
|
Writable |
WritableFactory.newInstance()
Return a new instance.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c)
Create a new instance of a class with a defined factory.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c,
Configuration conf)
Create a new instance of a class with a defined factory.
|
Writable |
ArrayFile.Reader.next(Writable value)
Read and return the next value in the file.
|
Writable |
SortedMapWritable.put(WritableComparable key,
Writable value) |
Writable |
MapWritable.put(Writable key,
Writable value) |
Writable |
SortedMapWritable.remove(Object key) |
Writable |
MapWritable.remove(Object key) |
| Modifier and Type | Method and Description |
|---|---|
Set<Map.Entry<WritableComparable,Writable>> |
SortedMapWritable.entrySet() |
Set<Map.Entry<Writable,Writable>> |
MapWritable.entrySet() |
Set<Map.Entry<Writable,Writable>> |
MapWritable.entrySet() |
SortedMap<WritableComparable,Writable> |
SortedMapWritable.headMap(WritableComparable toKey) |
Set<Writable> |
MapWritable.keySet() |
SortedMap<WritableComparable,Writable> |
SortedMapWritable.subMap(WritableComparable fromKey,
WritableComparable toKey) |
SortedMap<WritableComparable,Writable> |
SortedMapWritable.tailMap(WritableComparable fromKey) |
Collection<Writable> |
SortedMapWritable.values() |
Collection<Writable> |
MapWritable.values() |
| Modifier and Type | Method and Description |
|---|---|
void |
ArrayFile.Writer.append(Writable value)
Append a value to the file.
|
void |
BloomMapFile.Writer.append(WritableComparable key,
Writable val) |
void |
MapFile.Writer.append(WritableComparable key,
Writable val)
Append a key/value pair to the map.
|
void |
SequenceFile.Writer.append(Writable key,
Writable val)
Append a key/value pair.
|
static void |
WritableUtils.cloneInto(Writable dst,
Writable src)
Deprecated.
use ReflectionUtils.cloneInto instead.
|
protected void |
AbstractMapWritable.copy(Writable other)
Used by child copy constructors.
|
Writable |
ArrayFile.Reader.get(long n,
Writable value)
Return the
nth value in the file. |
Writable |
BloomMapFile.Reader.get(WritableComparable key,
Writable val)
Fast version of the
MapFile.Reader.get(WritableComparable, Writable) method. |
Writable |
MapFile.Reader.get(WritableComparable key,
Writable val)
Return the value for the named key, or null if none exists.
|
WritableComparable |
MapFile.Reader.getClosest(WritableComparable key,
Writable val)
Finds the record that is the closest match to the specified key.
|
WritableComparable |
MapFile.Reader.getClosest(WritableComparable key,
Writable val,
boolean before)
Finds the record that is the closest match to the specified key.
|
void |
SequenceFile.Reader.getCurrentValue(Writable val)
Get the 'value' corresponding to the last read 'key'.
|
Writable |
ArrayFile.Reader.next(Writable value)
Read and return the next value in the file.
|
boolean |
SequenceFile.Reader.next(Writable key)
Read the next key in the file into
key, skipping its
value. |
boolean |
MapFile.Reader.next(WritableComparable key,
Writable val)
Read the next key/value pair in the map into
key and
val. |
boolean |
SequenceFile.Reader.next(Writable key,
Writable val)
Read the next key/value pair in the file into
key and
val. |
Writable |
SortedMapWritable.put(WritableComparable key,
Writable value) |
Writable |
MapWritable.put(Writable key,
Writable value) |
void |
GenericWritable.set(Writable obj)
Set the instance that is wrapped.
|
void |
ArrayWritable.set(Writable[] values) |
void |
TwoDArrayWritable.set(Writable[][] values) |
static byte[] |
WritableUtils.toByteArray(Writable... writables)
Convert writables to a byte array
|
| Modifier and Type | Method and Description |
|---|---|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c)
Create a new instance of a class with a defined factory.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c,
Configuration conf)
Create a new instance of a class with a defined factory.
|
void |
MapWritable.putAll(Map<? extends Writable,? extends Writable> t) |
void |
MapWritable.putAll(Map<? extends Writable,? extends Writable> t) |
void |
SortedMapWritable.putAll(Map<? extends WritableComparable,? extends Writable> t) |
| Constructor and Description |
|---|
ArrayWritable(Class<? extends Writable> valueClass,
Writable[] values) |
TwoDArrayWritable(Class valueClass,
Writable[][] values) |
| Constructor and Description |
|---|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class<? extends Writable> valClass)
Create the named file for values of the named class.
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named file for values of the named class.
|
ArrayWritable(Class<? extends Writable> valueClass) |
ArrayWritable(Class<? extends Writable> valueClass,
Writable[] values) |
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
| Modifier and Type | Method and Description |
|---|---|
Deserializer<Writable> |
WritableSerialization.getDeserializer(Class<Writable> c) |
Serializer<Writable> |
WritableSerialization.getSerializer(Class<Writable> c) |
| Modifier and Type | Method and Description |
|---|---|
Deserializer<Writable> |
WritableSerialization.getDeserializer(Class<Writable> c) |
Serializer<Writable> |
WritableSerialization.getSerializer(Class<Writable> c) |
| Modifier and Type | Class and Description |
|---|---|
class |
ProtocolSignature |
| Modifier and Type | Method and Description |
|---|---|
abstract Writable |
Server.call(RPC.RpcKind rpcKind,
String protocol,
Writable param,
long receiveTime)
Called for each call.
|
Writable |
RPC.Server.call(RPC.RpcKind rpcKind,
String protocol,
Writable rpcRequest,
long receiveTime) |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable rpcRequest,
Client.ConnectionId remoteId)
Make a call, passing
rpcRequest, to the IPC server defined by
remoteId, returning the rpc respond. |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable rpcRequest,
Client.ConnectionId remoteId,
int serviceClass)
Make a call, passing
rpcRequest, to the IPC server defined by
remoteId, returning the rpc respond. |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress address)
Deprecated.
Use
Client.call(RPC.RpcKind, Writable,
ConnectionId) instead |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout)
Deprecated.
Use
Client.call(RPC.RpcKind, Writable,
ConnectionId) instead |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
Configuration conf)
Make a call, passing
param, to the IPC server running at
address which is servicing the protocol protocol,
with the ticket credentials, rpcTimeout as
timeout and conf as conf for this connection, returning the
value. |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress addr,
UserGroupInformation ticket)
Deprecated.
Use
Client.call(RPC.RpcKind, Writable,
ConnectionId) instead |
Writable |
Client.call(Writable param,
Client.ConnectionId remoteId)
Same as {link
Client.call(RPC.RpcKind, Writable, ConnectionId)
except the rpcKind is RPC_BUILTIN |
Writable |
Client.call(Writable param,
InetSocketAddress address)
Same as
Client.call(RPC.RpcKind, Writable, ConnectionId)
for RPC_BUILTIN |
Writable |
Client.call(Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
Configuration conf)
Same as
Client.call(RPC.RpcKind, Writable, InetSocketAddress,
Class, UserGroupInformation, int, Configuration)
except that rpcKind is writable. |
Writable |
Client.call(Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
int serviceClass,
Configuration conf)
Same as
Client.call(Writable, InetSocketAddress,
Class, UserGroupInformation, int, Configuration)
except that specifying serviceClass. |
Writable |
Server.call(Writable param,
long receiveTime)
Deprecated.
Use
#call(RpcPayloadHeader.RpcKind, String,
Writable, long) instead |
| Modifier and Type | Method and Description |
|---|---|
Class<? extends Writable> |
Server.getRpcRequestWrapper(RpcHeaderProtos.RpcKindProto rpcKind) |
| Modifier and Type | Method and Description |
|---|---|
abstract Writable |
Server.call(RPC.RpcKind rpcKind,
String protocol,
Writable param,
long receiveTime)
Called for each call.
|
Writable |
RPC.Server.call(RPC.RpcKind rpcKind,
String protocol,
Writable rpcRequest,
long receiveTime) |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable rpcRequest,
Client.ConnectionId remoteId)
Make a call, passing
rpcRequest, to the IPC server defined by
remoteId, returning the rpc respond. |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable rpcRequest,
Client.ConnectionId remoteId,
int serviceClass)
Make a call, passing
rpcRequest, to the IPC server defined by
remoteId, returning the rpc respond. |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress address)
Deprecated.
Use
Client.call(RPC.RpcKind, Writable,
ConnectionId) instead |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout)
Deprecated.
Use
Client.call(RPC.RpcKind, Writable,
ConnectionId) instead |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
Configuration conf)
Make a call, passing
param, to the IPC server running at
address which is servicing the protocol protocol,
with the ticket credentials, rpcTimeout as
timeout and conf as conf for this connection, returning the
value. |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress addr,
UserGroupInformation ticket)
Deprecated.
Use
Client.call(RPC.RpcKind, Writable,
ConnectionId) instead |
Writable |
Client.call(Writable param,
Client.ConnectionId remoteId)
Same as {link
Client.call(RPC.RpcKind, Writable, ConnectionId)
except the rpcKind is RPC_BUILTIN |
Writable |
Client.call(Writable param,
InetSocketAddress address)
Same as
Client.call(RPC.RpcKind, Writable, ConnectionId)
for RPC_BUILTIN |
Writable |
Client.call(Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
Configuration conf)
Same as
Client.call(RPC.RpcKind, Writable, InetSocketAddress,
Class, UserGroupInformation, int, Configuration)
except that rpcKind is writable. |
Writable |
Client.call(Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
int serviceClass,
Configuration conf)
Same as
Client.call(Writable, InetSocketAddress,
Class, UserGroupInformation, int, Configuration)
except that specifying serviceClass. |
Writable |
Server.call(Writable param,
long receiveTime)
Deprecated.
Use
#call(RpcPayloadHeader.RpcKind, String,
Writable, long) instead |
| Modifier and Type | Method and Description |
|---|---|
Client |
ClientCache.getClient(Configuration conf,
SocketFactory factory,
Class<? extends Writable> valueClass)
Construct & cache an IPC client with the user-provided SocketFactory
if no cached client exists.
|
static void |
Server.registerProtocolEngine(RPC.RpcKind rpcKind,
Class<? extends Writable> rpcRequestWrapperClass,
org.apache.hadoop.ipc.RPC.RpcInvoker rpcInvoker)
Register a RPC kind and the class to deserialize the rpc request.
|
| Constructor and Description |
|---|
Server.Call(int id,
int retryCount,
Writable param,
Server.Connection connection) |
Server.Call(int id,
int retryCount,
Writable param,
Server.Connection connection,
RPC.RpcKind kind,
byte[] clientId) |
| Constructor and Description |
|---|
Client(Class<? extends Writable> valueClass,
Configuration conf)
Construct an IPC client with the default SocketFactory
|
Client(Class<? extends Writable> valueClass,
Configuration conf,
SocketFactory factory)
Construct an IPC client whose values are of the given
Writable
class. |
RPC.Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig) |
Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf) |
Server(String bindAddress,
int port,
Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
SecretManager<? extends TokenIdentifier> secretManager) |
Server(String bindAddress,
int port,
Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig)
Constructs a server listening on the named port and address.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
InputSplit
InputSplit represents the data to be processed by an
individual Mapper. |
| Modifier and Type | Class and Description |
|---|---|
class |
ClusterStatus
Status information on the current state of the Map-Reduce cluster.
|
static class |
ClusterStatus.BlackListInfo
Class which encapsulates information about a blacklisted tasktracker.
|
static class |
Counters.Counter
A counter record, comprising its name and value.
|
static class |
Counters.Group
Group of counters, comprising of counters from a particular
counter Enum class. |
class |
JobConf
A map/reduce job configuration.
|
class |
JobProfile
A JobProfile is a MapReduce primitive.
|
class |
JobQueueInfo
Class that contains the information regarding the Job Queues which are
maintained by the Hadoop Map/Reduce framework.
|
class |
JvmTask
Task abstraction that can be serialized, implements the writable interface.
|
class |
MapTask
A Map task.
|
class |
MapTaskCompletionEventsUpdate
A class that represents the communication between the tasktracker and child
tasks w.r.t the map task completion events.
|
class |
MultiFileSplit
A sub-collection of input files.
|
class |
ReduceTask
A Reduce task.
|
class |
Task
Base class for tasks.
|
class |
TaskStatus
Describes the current status of a task.
|
class |
WrappedJvmID
A simple wrapper for increasing the visibility.
|
| Modifier and Type | Method and Description |
|---|---|
static <K extends WritableComparable,V extends Writable> |
MapFileOutputFormat.getEntry(MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
| Modifier and Type | Method and Description |
|---|---|
static <K extends WritableComparable,V extends Writable> |
MapFileOutputFormat.getEntry(MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
| Modifier and Type | Method and Description |
|---|---|
RecordWriter<WritableComparable,Writable> |
MapFileOutputFormat.getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress) |
static Class<? extends Writable> |
SequenceFileAsBinaryOutputFormat.getSequenceFileOutputValueClass(JobConf conf)
Get the value class for the
SequenceFile |
| Modifier and Type | Class and Description |
|---|---|
static class |
SleepJob.SleepSplit |
| Modifier and Type | Class and Description |
|---|---|
class |
ArrayListBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
|
interface |
ComposableInputFormat<K extends WritableComparable,V extends Writable>
Refinement of InputFormat requiring implementors to provide
ComposableRecordReader instead of RecordReader.
|
interface |
ComposableRecordReader<K extends WritableComparable,V extends Writable>
Additional operations required of a RecordReader to participate in a join.
|
class |
CompositeRecordReader<K extends WritableComparable,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
|
class |
CompositeRecordReader<K extends WritableComparable,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
|
class |
MultiFilterRecordReader<K extends WritableComparable,V extends Writable>
Base class for Composite join returning values derived from multiple
sources, but generally not tuples.
|
class |
OverrideRecordReader<K extends WritableComparable,V extends Writable>
Prefer the "rightmost" data source for this key.
|
interface |
ResetableIterator<T extends Writable>
This defines an interface to a stateful Iterator that can replay elements
added to it directly.
|
static class |
ResetableIterator.EMPTY<U extends Writable> |
class |
StreamBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
|
class |
WrappedRecordReader<K extends WritableComparable,U extends Writable>
Proxy class for a RecordReader participating in the join framework.
|
| Constructor and Description |
|---|
TupleWritable(Writable[] vals)
Initialize tuple with storage; unknown whether any of them contain
"written" values.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ValueAggregatorCombiner<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic combiner of Aggregate.
|
class |
ValueAggregatorJobBase<K1 extends WritableComparable,V1 extends Writable>
This abstract class implements some common functionalities of the
the generic mapper, reducer and combiner classes of Aggregate.
|
class |
ValueAggregatorMapper<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic mapper of Aggregate.
|
class |
ValueAggregatorReducer<K1 extends WritableComparable,V1 extends Writable>
This class implements the generic reducer of Aggregate.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
Counter
A named counter that tracks the progress of a map/reduce job.
|
interface |
CounterGroup
A group of
Counters that logically belong together. |
| Modifier and Type | Class and Description |
|---|---|
class |
ClusterMetrics
Status information on the current state of the Map-Reduce cluster.
|
class |
Counters
Counters holds per job/task counters, defined either by the
Map-Reduce framework or applications. |
class |
ID
A general identifier, which internally stores the id
as an integer.
|
class |
JobID
JobID represents the immutable and unique identifier for
the job.
|
class |
JobStatus
Describes the current status of a job.
|
class |
QueueAclsInfo
Class to encapsulate Queue ACLs for a particular
user.
|
class |
QueueInfo
Class that contains the information regarding the Job Queues which are
maintained by the Hadoop Map/Reduce framework.
|
class |
TaskAttemptID
TaskAttemptID represents the immutable and unique identifier for
a task attempt.
|
class |
TaskCompletionEvent
This is used to track task completion events on
job tracker.
|
class |
TaskID
TaskID represents the immutable and unique identifier for
a Map or Reduce Task.
|
class |
TaskReport
A report on the state of a task.
|
class |
TaskTrackerInfo
Information about TaskTracker.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
CounterGroupBase<T extends Counter>
The common counter group interface.
|
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractCounter
An abstract counter class to provide common implementation of
the counter interface in both mapred and mapreduce packages.
|
class |
AbstractCounterGroup<T extends Counter>
An abstract class to provide common implementation of the
generic counter group in both mapred and mapreduce package.
|
class |
AbstractCounters<C extends Counter,G extends CounterGroupBase<C>>
An abstract class to provide common implementation for the Counters
container in both mapred and mapreduce packages.
|
class |
FileSystemCounterGroup<C extends Counter>
An abstract class to provide common implementation of the filesystem
counter group in both mapred and mapreduce packages.
|
static class |
FileSystemCounterGroup.FSCounter |
class |
FrameworkCounterGroup<T extends Enum<T>,C extends Counter>
An abstract class to provide common implementation for the framework
counter group in both mapred and mapreduce packages.
|
static class |
FrameworkCounterGroup.FrameworkCounter<T extends Enum<T>>
A counter facade for framework counters.
|
class |
GenericCounter
A generic counter implementation
|
| Modifier and Type | Class and Description |
|---|---|
class |
ValueAggregatorCombiner<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic combiner of Aggregate.
|
class |
ValueAggregatorJobBase<K1 extends WritableComparable<?>,V1 extends Writable>
This abstract class implements some common functionalities of the
the generic mapper, reducer and combiner classes of Aggregate.
|
class |
ValueAggregatorMapper<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic mapper of Aggregate.
|
class |
ValueAggregatorReducer<K1 extends WritableComparable<?>,V1 extends Writable>
This class implements the generic reducer of Aggregate.
|
| Modifier and Type | Class and Description |
|---|---|
static class |
DataDrivenDBInputFormat.DataDrivenDBInputSplit
A InputSplit that spans a set of rows
|
static class |
DBInputFormat.DBInputSplit
A InputSplit that spans a set of rows
|
static class |
DBInputFormat.NullDBWritable
A Class that does nothing, implementing DBWritable
|
| Modifier and Type | Class and Description |
|---|---|
class |
CombineFileSplit
A sub-collection of input files.
|
class |
FileSplit
A section of an input file.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ArrayListBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
|
class |
ComposableInputFormat<K extends WritableComparable<?>,V extends Writable>
Refinement of InputFormat requiring implementors to provide
ComposableRecordReader instead of RecordReader.
|
class |
ComposableRecordReader<K extends WritableComparable<?>,V extends Writable>
Additional operations required of a RecordReader to participate in a join.
|
class |
CompositeRecordReader<K extends WritableComparable<?>,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
|
class |
CompositeRecordReader<K extends WritableComparable<?>,V extends Writable,X extends Writable>
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
|
class |
MultiFilterRecordReader<K extends WritableComparable<?>,V extends Writable>
Base class for Composite join returning values derived from multiple
sources, but generally not tuples.
|
class |
OverrideRecordReader<K extends WritableComparable<?>,V extends Writable>
Prefer the "rightmost" data source for this key.
|
interface |
ResetableIterator<T extends Writable>
This defines an interface to a stateful Iterator that can replay elements
added to it directly.
|
static class |
ResetableIterator.EMPTY<U extends Writable> |
class |
StreamBackedIterator<X extends Writable>
This class provides an implementation of ResetableIterator.
|
class |
WrappedRecordReader<K extends WritableComparable<?>,U extends Writable>
Proxy class for a RecordReader participating in the join framework.
|
| Modifier and Type | Class and Description |
|---|---|
class |
CompositeInputSplit
This InputSplit contains a set of child InputSplits.
|
class |
TupleWritable
Writable type storing multiple
Writables. |
| Modifier and Type | Field and Description |
|---|---|
protected X |
CompositeRecordReader.value |
| Modifier and Type | Method and Description |
|---|---|
Writable |
TupleWritable.get(int i)
Get ith Writable from Tuple.
|
| Modifier and Type | Method and Description |
|---|---|
Iterator<Writable> |
TupleWritable.iterator()
Return an iterator over the elements in this tuple.
|
| Constructor and Description |
|---|
TupleWritable(Writable[] vals)
Initialize tuple with storage; unknown whether any of them contain
"written" values.
|
| Modifier and Type | Method and Description |
|---|---|
static <K extends WritableComparable<?>,V extends Writable> |
MapFileOutputFormat.getEntry(MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
| Modifier and Type | Method and Description |
|---|---|
static <K extends WritableComparable<?>,V extends Writable> |
MapFileOutputFormat.getEntry(MapFile.Reader[] readers,
Partitioner<K,V> partitioner,
K key,
V value)
Get an entry from output generated by this class.
|
| Modifier and Type | Method and Description |
|---|---|
RecordWriter<WritableComparable<?>,Writable> |
MapFileOutputFormat.getRecordWriter(TaskAttemptContext context) |
static Class<? extends Writable> |
SequenceFileAsBinaryOutputFormat.getSequenceFileOutputValueClass(JobContext job)
Get the value class for the
SequenceFile |
| Modifier and Type | Class and Description |
|---|---|
class |
JobTokenIdentifier
The token identifier for job token
|
| Modifier and Type | Class and Description |
|---|---|
static class |
JobSplit.SplitMetaInfo
This represents the meta information about the task split.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ShuffleHeader
Shuffle Header information that is sent by the TaskTracker and
deciphered by the Fetcher thread of Reduce task
|
| Modifier and Type | Class and Description |
|---|---|
class |
MRDelegationTokenIdentifier
TokenIdentifier that identifies delegation tokens
issued by JobHistoryServer to delegate
MR tasks talking to the JobHistoryServer. |
| Modifier and Type | Class and Description |
|---|---|
class |
Record
Deprecated.
Replaced by Avro.
|
| Modifier and Type | Class and Description |
|---|---|
class |
RecordTypeInfo
Deprecated.
Replaced by Avro.
|
| Modifier and Type | Class and Description |
|---|---|
class |
Credentials
A class that provides the facilities of reading and writing
secret keys and Tokens.
|
| Modifier and Type | Class and Description |
|---|---|
class |
AccessControlList
Class representing a configured access control list.
|
| Modifier and Type | Class and Description |
|---|---|
class |
Token<T extends TokenIdentifier>
The client-side form of the token.
|
static class |
Token.PrivateToken<T extends TokenIdentifier>
Indicates whether the token is a clone.
|
class |
TokenIdentifier
An identifier that identifies a token, may contain public information
about a token, including its kind (or type).
|
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractDelegationTokenIdentifier |
class |
DelegationKey
Key used for generating and verifying delegation tokens
|
| Modifier and Type | Method and Description |
|---|---|
void |
RawBytesInputWriter.writeKey(Writable key) |
void |
RawBytesInputWriter.writeValue(Writable value) |
| Modifier and Type | Class and Description |
|---|---|
class |
ResourceUsageMetrics
Captures the resource usage metrics.
|
| Modifier and Type | Class and Description |
|---|---|
class |
TypedBytesWritable
Writable for typed bytes.
|
| Modifier and Type | Method and Description |
|---|---|
Writable |
TypedBytesWritableInput.read() |
Writable |
TypedBytesWritableInput.readWritable() |
Writable |
TypedBytesWritableInput.readWritable(Writable writable) |
| Modifier and Type | Method and Description |
|---|---|
Class<? extends Writable> |
TypedBytesWritableInput.readType() |
| Modifier and Type | Method and Description |
|---|---|
Writable |
TypedBytesWritableInput.readWritable(Writable writable) |
void |
TypedBytesWritableOutput.write(Writable w) |
void |
TypedBytesWritableOutput.writeWritable(Writable w) |
| Modifier and Type | Method and Description |
|---|---|
static void |
ReflectionUtils.cloneWritableInto(Writable dst,
Writable src)
Deprecated.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BloomFilter
Implements a Bloom filter, as defined by Bloom in 1970.
|
class |
CountingBloomFilter
Implements a counting Bloom filter, as defined by Fan et al.
|
class |
DynamicBloomFilter
Implements a dynamic Bloom filter, as defined in the INFOCOM 2006 paper.
|
class |
Filter
Defines the general behavior of a filter.
|
class |
Key
The general behavior of a key that must be stored in a filter.
|
class |
RetouchedBloomFilter
Implements a retouched Bloom filter, as defined in the CoNEXT 2006 paper.
|
| Modifier and Type | Class and Description |
|---|---|
class |
YarnConfiguration |
| Modifier and Type | Class and Description |
|---|---|
static class |
AggregatedLogFormat.LogKey |
| Modifier and Type | Class and Description |
|---|---|
class |
AMRMTokenIdentifier
AMRMTokenIdentifier is the TokenIdentifier to be used by
ApplicationMasters to authenticate to the ResourceManager.
|
class |
ContainerTokenIdentifier
TokenIdentifier for a container.
|
class |
NMTokenIdentifier |
| Modifier and Type | Class and Description |
|---|---|
class |
ClientToAMTokenIdentifier |
class |
RMDelegationTokenIdentifier
Delegation Token Identifier that identifies the delegation tokens from the
Resource Manager.
|
| Modifier and Type | Class and Description |
|---|---|
class |
LocalizerTokenIdentifier |
| Modifier and Type | Class and Description |
|---|---|
class |
CapacitySchedulerConfiguration |
| Modifier and Type | Class and Description |
|---|---|
class |
FairSchedulerConfiguration |
Copyright © 2013 Apache Software Foundation. All rights reserved.