FSNamesystem (Apache Hadoop Main 2.2.0 API)

java.lang.Object
- org.apache.hadoop.hdfs.server.namenode.FSNamesystem

All Implemented Interfaces:

FSClusterStats, FSNamesystemMBean, NameNodeMXBean, Namesystem, SafeMode, RwLock
```
@InterfaceAudience.Private
@Metrics(context="dfs")
public class FSNamesystem
extends Object
implements Namesystem, FSClusterStats, FSNamesystemMBean, NameNodeMXBean
```
FSNamesystem does the actual bookkeeping work for the DataNode. It tracks several important tables. 1) valid fsname --> blocklist (kept on disk, logged) 2) Set of all valid blocks (inverted #1) 3) block --> machinelist (kept in memory, rebuilt dynamically from reports) 4) machine --> blocklist (inverted #2) 5) LRU cache of updated-heartbeat machines

Field Summary

Fields
Modifier and Type	Field and Description
`static org.apache.commons.logging.Log`	`auditLog` Logger for audit events, noting successful FSNamesystem operations.
`static org.apache.commons.logging.Log`	`LOG`

Method Summary

Methods
Modifier and Type	Method and Description
`void`	`adjustSafeModeBlockTotals(int deltaSafe, int deltaTotal)` Adjust the total number of blocks safe and expected during safe mode.
`long`	`allocateNewInodeId()` Allocate a new inode ID.
`void`	`checkOperation(NameNode.OperationCategory op)`
`void`	`checkSafeMode()` Check safe mode conditions.
`void`	`checkSuperuserPrivilege()` Check if the user has superuser privilege.
`void`	`decrementSafeBlockCount(Block b)` Decrement number of blocks that reached minimal replication.
`int`	`getBlockCapacity()`
`BlockManager`	`getBlockManager()`
`String`	`getBlockPoolId()` Gets the block pool id.
`long`	`getBlockPoolUsedSpace()` Get the total space used by the block pools of this namenode
`long`	`getBlocksTotal()` Get the total number of blocks in the system.
`long`	`getCapacityRemaining()` Free (unused) storage capacity
`float`	`getCapacityRemainingGB()`
`long`	`getCapacityTotal()` Total storage capacity
`float`	`getCapacityTotalGB()`
`long`	`getCapacityUsed()` Used storage capacity
`float`	`getCapacityUsedGB()`
`long`	`getCapacityUsedNonDFS()`
`String`	`getClusterId()` Gets the cluster id.
`long`	`getCorruptReplicaBlocks()` Returns number of blocks with corrupt replicas
`String`	`getDeadNodes()` Returned information is a JSON representation of map with host name as the key and value is a map of dead node attribute keys to its values
`String`	`getDecomNodes()` Returned information is a JSON representation of map with host name as the key and value is a map of decomisioning node attribute keys to its values
`int`	`getDistinctVersionCount()` Get the number of distinct versions of live datanodes
`Map<String,Integer>`	`getDistinctVersions()` Get the number of live datanodes for each distinct versions
`FSEditLog`	`getEditLog()`
`EditLogTailer`	`getEditLogTailer()`
`long`	`getExcessBlocks()`
`int`	`getExpiredHeartbeats()`
`long`	`getFilesTotal()` Total number of files and directories
`long`	`getFree()` Gets total non-used raw bytes.
`FSDirectory`	`getFSDirectory()`
`FSImage`	`getFSImage()`
`String`	`getFSState()` The state of the file system: Safemode or Operational
`String`	`getHAState()`
`String`	`getJournalTransactionInfo()` Get information about the transaction ID, including the last applied transaction ID and the most recent checkpoint's transaction ID
`long`	`getLastCheckpointTime()`
`long`	`getLastInodeId()`
`long`	`getLastWrittenTransactionId()`
`String`	`getLiveNodes()` Returned information is a JSON representation of map with host name as the key and value is a map of live node attribute keys to its values
`long`	`getMillisSinceLastLoadedEdits()`
`long`	`getMissingBlocksCount()`
`String`	`getNameDirStatuses()` Get status information about the directories storing image and edits logs of the NN.
`static Collection<URI>`	`getNamespaceDirs(Configuration conf)`
`static List<URI>`	`getNamespaceEditsDirs(Configuration conf)` Return an ordered list of edits directories to write to.
`static List<URI>`	`getNamespaceEditsDirs(Configuration conf, boolean includeShared)`
`long`	`getNonDfsUsedSpace()` Gets total used space by data nodes for non DFS purposes such as storing temporary files on the local file system
`long`	`getNumberOfMissingBlocks()` Gets the total number of missing blocks on the cluster
`int`	`getNumDeadDataNodes()` Number of dead data nodes
`int`	`getNumLiveDataNodes()` Number of Live data nodes
`int`	`getNumSnapshots()`
`int`	`getNumSnapshottableDirs()`
`int`	`getNumStaleDataNodes()` Number of stale data nodes
`int`	`getPendingDataNodeMessageCount()`
`long`	`getPendingDeletionBlocks()`
`long`	`getPendingReplicationBlocks()` Blocks pending to be replicated
`float`	`getPercentBlockPoolUsed()` Get the total space used by the block pool as percentage of total capacity
`float`	`getPercentRemaining()` Gets the total remaining space by data nodes as percentage of total capacity
`float`	`getPercentUsed()` Gets the total used space by data nodes as percentage of total capacity
`long`	`getPostponedMisreplicatedBlocks()`
`static Collection<URI>`	`getRequiredNamespaceEditsDirs(Configuration conf)` Get all edits dirs which are required.
`RetryCache`	`getRetryCache()`
`String`	`getSafemode()` Gets the safemode status
`org.apache.hadoop.hdfs.server.namenode.FSNamesystem.SafeModeInfo`	`getSafeModeInfoForTests()`
`long`	`getScheduledReplicationBlocks()` Blocks scheduled for replication
`static List<URI>`	`getSharedEditsDirs(Configuration conf)` Returns edit directories that are shared between primary and secondary.
`SnapshotManager`	`getSnapshotManager()`
`SnapshottableDirectoryStatus[]`	`getSnapshottableDirListing()` Get the list of snapshottable directories that are owned by the current user.
`String`	`getSoftwareVersion()` Get the version of software running on the Namenode
`int`	`getThreads()` Gets the number of threads.
`long`	`getTotal()` Gets total raw bytes including non-dfs used space.
`long`	`getTotalBlocks()` Gets the total numbers of blocks on the cluster.
`long`	`getTotalFiles()` Gets the total number of files on the cluster
`int`	`getTotalLoad()` Total number of connections.
`long`	`getTransactionsSinceLastCheckpoint()`
`long`	`getTransactionsSinceLastLogRoll()`
`long`	`getUnderReplicatedBlocks()` Blocks under replicated
`long`	`getUsed()` Gets the used space by data nodes.
`String`	`getVersion()` Class representing Namenode information for JMX interfaces
`boolean`	`hasReadLock()` Check if the current thread holds read lock.
`boolean`	`hasReadOrWriteLock()` Check if the current thread holds read or write lock.
`boolean`	`hasWriteLock()` Check if the current thread holds write lock.
`void`	`incrementSafeBlockCount(int replication)` Increment number of blocks that reached minimal replication.
`boolean`	`isAuditEnabled()`
`boolean`	`isAvoidingStaleDataNodesForWrite()` Indicate whether or not the cluster is now avoiding to use stale DataNodes for writing.
`boolean`	`isGenStampInFuture(Block block)`
`boolean`	`isInSafeMode()` Is the system in safe mode?
`boolean`	`isInStandbyState()`
`boolean`	`isInStartupSafeMode()` Is the system in startup safe mode, i.e.
`boolean`	`isPopulatingReplQueues()` Check if replication queues are to be populated
`boolean`	`isRunning()` Is this name system running?
`boolean`	`isUpgradeFinalized()` Checks if upgrade is finalized.
`static FSNamesystem`	`loadFromDisk(Configuration conf)` Instantiates an FSNamesystem loaded from the image and edits directories specified in the passed Configuration.
`void`	`logExpireDelegationToken(DelegationTokenIdentifier id)` Log the cancellation of expired tokens to edit logs
`void`	`logUpdateMasterKey(DelegationKey key)` Log the updateMasterKey operation to edit logs
`void`	`processIncrementalBlockReport(DatanodeID nodeID, String poolId, ReceivedDeletedBlockInfo[] blockInfos)`
`void`	`readLock()` Acquire read lock.
`void`	`readUnlock()` Release read lock.
`void`	`resetLastInodeId(long newValue)` Set the last allocated inode id when fsimage or editlog is loaded.
`void`	`setBlockTotal()` Set the total number of blocks in the system.
`void`	`setNNResourceChecker(NameNodeResourceChecker nnResourceChecker)`
`void`	`verifyToken(DelegationTokenIdentifier identifier, byte[] password)` Verifies that the given identifier and password are valid and match.
`void`	`writeLock()` Acquire write lock.
`void`	`writeLockInterruptibly()` Acquire write lock, unless interrupted while waiting
`void`	`writeUnlock()` Release write lock.

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Field Detail
  - LOG
```
public static final org.apache.commons.logging.Log LOG
```
  - auditLog
```
public static final org.apache.commons.logging.Log auditLog
```
    Logger for audit events, noting successful FSNamesystem operations. Emits to FSNamesystem.audit at INFO. Each event causes a set of tab-separated key=value pairs to be written for the following properties: ugi=<ugi in RPC> ip=<remote IP> cmd=<command> src=<src path> dst=<dst path (optional)> perm=<permissions (optional)>
- Method Detail
  - isAuditEnabled
```
public boolean isAuditEnabled()
```
  - resetLastInodeId
```
public void resetLastInodeId(long newValue)
                      throws IOException
```
    Set the last allocated inode id when fsimage or editlog is loaded.
    
    Throws:
    
    IOException
  - getLastInodeId
```
public long getLastInodeId()
```
    Returns:
    the last inode ID.
  - allocateNewInodeId
```
public long allocateNewInodeId()
```
    Allocate a new inode ID.
  - loadFromDisk
```
public static FSNamesystem loadFromDisk(Configuration conf)
                                 throws IOException
```
    Instantiates an FSNamesystem loaded from the image and edits directories specified in the passed Configuration.
    
    Parameters:
    conf - the Configuration which specifies the storage directories from which to load
    
    Returns:
    an FSNamesystem which contains the loaded namespace
    
    Throws:
    
    IOException - if loading fails
  - getRetryCache
```
public RetryCache getRetryCache()
```
  - checkOperation
```
public void checkOperation(NameNode.OperationCategory op)
                    throws StandbyException
```
    Specified by:
    
    checkOperation in interface Namesystem
    
    Throws:
    
    StandbyException
  - getNamespaceDirs
```
public static Collection<URI> getNamespaceDirs(Configuration conf)
```
  - getRequiredNamespaceEditsDirs
```
public static Collection<URI> getRequiredNamespaceEditsDirs(Configuration conf)
```
    Get all edits dirs which are required. If any shared edits dirs are configured, these are also included in the set of required dirs.
    
    Parameters:
    conf - the HDFS configuration.
    
    Returns:
    all required dirs.
  - getNamespaceEditsDirs
```
public static List<URI> getNamespaceEditsDirs(Configuration conf)
                                       throws IOException
```
    Return an ordered list of edits directories to write to. The list is ordered such that all shared edits directories are ordered before non-shared directories, and any duplicates are removed. The order they are specified in the configuration is retained.
    
    Returns:
    Collection of shared edits directories.
    
    Throws:
    
    IOException - if multiple shared edits directories are configured
  - getNamespaceEditsDirs
```
public static List<URI> getNamespaceEditsDirs(Configuration conf,
                              boolean includeShared)
                                       throws IOException
```
    Throws:
    
    IOException
  - getSharedEditsDirs
```
public static List<URI> getSharedEditsDirs(Configuration conf)
```
    Returns edit directories that are shared between primary and secondary.
    
    Parameters:
    conf -
    
    Returns:
    Collection of edit directories.
  - readLock
```
public void readLock()
```
    Description copied from interface: RwLock
    
    Acquire read lock.
    
    Specified by:
    
    readLock in interface RwLock
  - readUnlock
```
public void readUnlock()
```
    Description copied from interface: RwLock
    
    Release read lock.
    
    Specified by:
    
    readUnlock in interface RwLock
  - writeLock
```
public void writeLock()
```
    Description copied from interface: RwLock
    
    Acquire write lock.
    
    Specified by:
    
    writeLock in interface RwLock
  - writeLockInterruptibly
```
public void writeLockInterruptibly()
                            throws InterruptedException
```
    Description copied from interface: RwLock
    
    Acquire write lock, unless interrupted while waiting
    
    Specified by:
    
    writeLockInterruptibly in interface RwLock
    
    Throws:
    
    InterruptedException
  - writeUnlock
```
public void writeUnlock()
```
    Description copied from interface: RwLock
    
    Release write lock.
    
    Specified by:
    
    writeUnlock in interface RwLock
  - hasWriteLock
```
public boolean hasWriteLock()
```
    Description copied from interface: RwLock
    
    Check if the current thread holds write lock.
    
    Specified by:
    
    hasWriteLock in interface RwLock
  - hasReadLock
```
public boolean hasReadLock()
```
    Description copied from interface: RwLock
    
    Check if the current thread holds read lock.
    
    Specified by:
    
    hasReadLock in interface RwLock
  - hasReadOrWriteLock
```
public boolean hasReadOrWriteLock()
```
    Description copied from interface: RwLock
    
    Check if the current thread holds read or write lock.
    
    Specified by:
    
    hasReadOrWriteLock in interface RwLock
  - isRunning
```
public boolean isRunning()
```
    Description copied from interface: Namesystem
    
    Is this name system running?
    
    Specified by:
    
    isRunning in interface Namesystem
  - isInStandbyState
```
public boolean isInStandbyState()
```
    Specified by:
    
    isInStandbyState in interface Namesystem
  - getFSImage
```
public FSImage getFSImage()
```
  - getEditLog
```
public FSEditLog getEditLog()
```
  - getMissingBlocksCount
```
@Metric(value={"MissingBlocks","Number of missing blocks"})
public long getMissingBlocksCount()
```
  - getExpiredHeartbeats
```
@Metric(value={"ExpiredHeartbeats","Number of expired heartbeats"})
public int getExpiredHeartbeats()
```
  - getTransactionsSinceLastCheckpoint
```
@Metric(value={"TransactionsSinceLastCheckpoint","Number of transactions since last checkpoint"})
public long getTransactionsSinceLastCheckpoint()
```
  - getTransactionsSinceLastLogRoll
```
@Metric(value={"TransactionsSinceLastLogRoll","Number of transactions since last edit log roll"})
public long getTransactionsSinceLastLogRoll()
```
  - getLastWrittenTransactionId
```
@Metric(value={"LastWrittenTransactionId","Transaction ID written to the edit log"})
public long getLastWrittenTransactionId()
```
  - getLastCheckpointTime
```
@Metric(value={"LastCheckpointTime","Time in milliseconds since the epoch of the last checkpoint"})
public long getLastCheckpointTime()
```
  - getCapacityTotal
```
@Metric(value={"CapacityTotal","Total raw capacity of data nodes in bytes"})
public long getCapacityTotal()
```
    Description copied from interface: FSNamesystemMBean
    
    Total storage capacity
    
    Specified by:
    
    getCapacityTotal in interface FSNamesystemMBean
    
    Returns:
    - total capacity in bytes
  - getCapacityTotalGB
```
@Metric(value={"CapacityTotalGB","Total raw capacity of data nodes in GB"})
public float getCapacityTotalGB()
```
  - getCapacityUsed
```
@Metric(value={"CapacityUsed","Total used capacity across all data nodes in bytes"})
public long getCapacityUsed()
```
    Description copied from interface: FSNamesystemMBean
    
    Used storage capacity
    
    Specified by:
    
    getCapacityUsed in interface FSNamesystemMBean
    
    Returns:
    - used capacity in bytes
  - getCapacityUsedGB
```
@Metric(value={"CapacityUsedGB","Total used capacity across all data nodes in GB"})
public float getCapacityUsedGB()
```
  - getCapacityRemaining
```
@Metric(value={"CapacityRemaining","Remaining capacity in bytes"})
public long getCapacityRemaining()
```
    Description copied from interface: FSNamesystemMBean
    
    Free (unused) storage capacity
    
    Specified by:
    
    getCapacityRemaining in interface FSNamesystemMBean
    
    Returns:
    - free capacity in bytes
  - getCapacityRemainingGB
```
@Metric(value={"CapacityRemainingGB","Remaining capacity in GB"})
public float getCapacityRemainingGB()
```
  - getCapacityUsedNonDFS
```
@Metric(value={"CapacityUsedNonDFS","Total space used by data nodes for non DFS purposes in bytes"})
public long getCapacityUsedNonDFS()
```
  - getTotalLoad
```
@Metric
public int getTotalLoad()
```
    Total number of connections.
    
    Specified by:
    
    getTotalLoad in interface FSClusterStats
    
    Specified by:
    
    getTotalLoad in interface FSNamesystemMBean
    
    Returns:
    a count of the total number of block transfers and block writes that are currently occuring on the cluster.
  - getNumSnapshottableDirs
```
@Metric(value={"SnapshottableDirectories","Number of snapshottable directories"})
public int getNumSnapshottableDirs()
```
  - getNumSnapshots
```
@Metric(value={"Snapshots","The number of snapshots"})
public int getNumSnapshots()
```
  - checkSafeMode
```
public void checkSafeMode()
```
    Description copied from interface: SafeMode
    
    Check safe mode conditions. If the corresponding conditions are satisfied, trigger the system to enter/leave safe mode.
    
    Specified by:
    
    checkSafeMode in interface SafeMode
  - isInSafeMode
```
public boolean isInSafeMode()
```
    Description copied from interface: SafeMode
    
    Is the system in safe mode?
    
    Specified by:
    
    isInSafeMode in interface SafeMode
  - isInStartupSafeMode
```
public boolean isInStartupSafeMode()
```
    Description copied from interface: SafeMode
    
    Is the system in startup safe mode, i.e. the system is starting up with safe mode turned on automatically?
    
    Specified by:
    
    isInStartupSafeMode in interface SafeMode
  - isPopulatingReplQueues
```
public boolean isPopulatingReplQueues()
```
    Check if replication queues are to be populated
    
    Specified by:
    
    isPopulatingReplQueues in interface SafeMode
    
    Returns:
    true when node is HAState.Active and not in the very first safemode
  - incrementSafeBlockCount
```
public void incrementSafeBlockCount(int replication)
```
    Description copied from interface: SafeMode
    
    Increment number of blocks that reached minimal replication.
    
    Specified by:
    
    incrementSafeBlockCount in interface SafeMode
    
    Parameters:
    replication - current replication
  - decrementSafeBlockCount
```
public void decrementSafeBlockCount(Block b)
```
    Description copied from interface: SafeMode
    
    Decrement number of blocks that reached minimal replication.
    
    Specified by:
    
    decrementSafeBlockCount in interface SafeMode
  - adjustSafeModeBlockTotals
```
public void adjustSafeModeBlockTotals(int deltaSafe,
                             int deltaTotal)
```
    Adjust the total number of blocks safe and expected during safe mode. If safe mode is not currently on, this is a no-op.
    
    Specified by:
    
    adjustSafeModeBlockTotals in interface Namesystem
    
    Parameters:
    deltaSafe - the change in number of safe blocks
    deltaTotal - the change i nnumber of total blocks expected
  - setBlockTotal
```
public void setBlockTotal()
```
    Set the total number of blocks in the system.
  - getBlocksTotal
```
@Metric
public long getBlocksTotal()
```
    Get the total number of blocks in the system.
    
    Specified by:
    
    getBlocksTotal in interface FSNamesystemMBean
    
    Returns:
    - number of allocated blocks
  - processIncrementalBlockReport
```
public void processIncrementalBlockReport(DatanodeID nodeID,
                                 String poolId,
                                 ReceivedDeletedBlockInfo[] blockInfos)
                                   throws IOException
```
    Throws:
    
    IOException
  - checkSuperuserPrivilege
```
public void checkSuperuserPrivilege()
                             throws AccessControlException
```
    Description copied from interface: Namesystem
    
    Check if the user has superuser privilege.
    
    Specified by:
    
    checkSuperuserPrivilege in interface Namesystem
    
    Throws:
    
    AccessControlException
  - getFilesTotal
```
@Metric
public long getFilesTotal()
```
    Description copied from interface: FSNamesystemMBean
    
    Total number of files and directories
    
    Specified by:
    
    getFilesTotal in interface FSNamesystemMBean
    
    Returns:
    - num of files and directories
  - getPendingReplicationBlocks
```
@Metric
public long getPendingReplicationBlocks()
```
    Description copied from interface: FSNamesystemMBean
    
    Blocks pending to be replicated
    
    Specified by:
    
    getPendingReplicationBlocks in interface FSNamesystemMBean
    
    Returns:
    - num of blocks to be replicated
  - getUnderReplicatedBlocks
```
@Metric
public long getUnderReplicatedBlocks()
```
    Description copied from interface: FSNamesystemMBean
    
    Blocks under replicated
    
    Specified by:
    
    getUnderReplicatedBlocks in interface FSNamesystemMBean
    
    Returns:
    - num of blocks under replicated
  - getCorruptReplicaBlocks
```
@Metric(value={"CorruptBlocks","Number of blocks with corrupt replicas"})
public long getCorruptReplicaBlocks()
```
    Returns number of blocks with corrupt replicas
  - getScheduledReplicationBlocks
```
@Metric
public long getScheduledReplicationBlocks()
```
    Description copied from interface: FSNamesystemMBean
    
    Blocks scheduled for replication
    
    Specified by:
    
    getScheduledReplicationBlocks in interface FSNamesystemMBean
    
    Returns:
    - num of blocks scheduled for replication
  - getPendingDeletionBlocks
```
@Metric
public long getPendingDeletionBlocks()
```
  - getExcessBlocks
```
@Metric
public long getExcessBlocks()
```
  - getPostponedMisreplicatedBlocks
```
@Metric
public long getPostponedMisreplicatedBlocks()
```
  - getPendingDataNodeMessageCount
```
@Metric
public int getPendingDataNodeMessageCount()
```
  - getHAState
```
@Metric
public String getHAState()
```
  - getMillisSinceLastLoadedEdits
```
@Metric
public long getMillisSinceLastLoadedEdits()
```
  - getBlockCapacity
```
@Metric
public int getBlockCapacity()
```
  - getFSState
```
public String getFSState()
```
    Description copied from interface: FSNamesystemMBean
    
    The state of the file system: Safemode or Operational
    
    Specified by:
    
    getFSState in interface FSNamesystemMBean
    
    Returns:
    the state
  - getNumLiveDataNodes
```
public int getNumLiveDataNodes()
```
    Description copied from interface: FSNamesystemMBean
    
    Number of Live data nodes
    
    Specified by:
    
    getNumLiveDataNodes in interface FSNamesystemMBean
    
    Returns:
    number of live data nodes
  - getNumDeadDataNodes
```
public int getNumDeadDataNodes()
```
    Description copied from interface: FSNamesystemMBean
    
    Number of dead data nodes
    
    Specified by:
    
    getNumDeadDataNodes in interface FSNamesystemMBean
    
    Returns:
    number of dead data nodes
  - getNumStaleDataNodes
```
@Metric(value={"StaleDataNodes","Number of datanodes marked stale due to delayed heartbeat"})
public int getNumStaleDataNodes()
```
    Description copied from interface: FSNamesystemMBean
    
    Number of stale data nodes
    
    Specified by:
    
    getNumStaleDataNodes in interface FSNamesystemMBean
    
    Returns:
    number of stale data nodes
  - logUpdateMasterKey
```
public void logUpdateMasterKey(DelegationKey key)
```
    Log the updateMasterKey operation to edit logs
    
    Parameters:
    key - new delegation key.
  - logExpireDelegationToken
```
public void logExpireDelegationToken(DelegationTokenIdentifier id)
```
    Log the cancellation of expired tokens to edit logs
    
    Parameters:
    id - token identifier to cancel
  - getVersion
```
public String getVersion()
```
    Class representing Namenode information for JMX interfaces
    
    Specified by:
    
    getVersion in interface NameNodeMXBean
    
    Returns:
    the version
  - getUsed
```
public long getUsed()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the used space by data nodes.
    
    Specified by:
    
    getUsed in interface NameNodeMXBean
    
    Returns:
    the used space by data nodes
  - getFree
```
public long getFree()
```
    Description copied from interface: NameNodeMXBean
    
    Gets total non-used raw bytes.
    
    Specified by:
    
    getFree in interface NameNodeMXBean
    
    Returns:
    total non-used raw bytes
  - getTotal
```
public long getTotal()
```
    Description copied from interface: NameNodeMXBean
    
    Gets total raw bytes including non-dfs used space.
    
    Specified by:
    
    getTotal in interface NameNodeMXBean
    
    Returns:
    the total raw bytes including non-dfs used space
  - getSafemode
```
public String getSafemode()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the safemode status
    
    Specified by:
    
    getSafemode in interface NameNodeMXBean
    
    Returns:
    the safemode status
  - isUpgradeFinalized
```
public boolean isUpgradeFinalized()
```
    Description copied from interface: NameNodeMXBean
    
    Checks if upgrade is finalized.
    
    Specified by:
    
    isUpgradeFinalized in interface NameNodeMXBean
    
    Returns:
    true, if upgrade is finalized
  - getNonDfsUsedSpace
```
public long getNonDfsUsedSpace()
```
    Description copied from interface: NameNodeMXBean
    
    Gets total used space by data nodes for non DFS purposes such as storing temporary files on the local file system
    
    Specified by:
    
    getNonDfsUsedSpace in interface NameNodeMXBean
    
    Returns:
    the non dfs space of the cluster
  - getPercentUsed
```
public float getPercentUsed()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the total used space by data nodes as percentage of total capacity
    
    Specified by:
    
    getPercentUsed in interface NameNodeMXBean
    
    Returns:
    the percentage of used space on the cluster.
  - getBlockPoolUsedSpace
```
public long getBlockPoolUsedSpace()
```
    Description copied from interface: NameNodeMXBean
    
    Get the total space used by the block pools of this namenode
    
    Specified by:
    
    getBlockPoolUsedSpace in interface NameNodeMXBean
  - getPercentBlockPoolUsed
```
public float getPercentBlockPoolUsed()
```
    Description copied from interface: NameNodeMXBean
    
    Get the total space used by the block pool as percentage of total capacity
    
    Specified by:
    
    getPercentBlockPoolUsed in interface NameNodeMXBean
  - getPercentRemaining
```
public float getPercentRemaining()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the total remaining space by data nodes as percentage of total capacity
    
    Specified by:
    
    getPercentRemaining in interface NameNodeMXBean
    
    Returns:
    the percentage of the remaining space on the cluster
  - getTotalBlocks
```
public long getTotalBlocks()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the total numbers of blocks on the cluster.
    
    Specified by:
    
    getTotalBlocks in interface NameNodeMXBean
    
    Returns:
    the total number of blocks of the cluster
  - getTotalFiles
```
@Metric
public long getTotalFiles()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the total number of files on the cluster
    
    Specified by:
    
    getTotalFiles in interface NameNodeMXBean
    
    Returns:
    the total number of files on the cluster
  - getNumberOfMissingBlocks
```
public long getNumberOfMissingBlocks()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the total number of missing blocks on the cluster
    
    Specified by:
    
    getNumberOfMissingBlocks in interface NameNodeMXBean
    
    Returns:
    the total number of files and blocks on the cluster
  - getThreads
```
public int getThreads()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the number of threads.
    
    Specified by:
    
    getThreads in interface NameNodeMXBean
    
    Returns:
    the number of threads
  - getLiveNodes
```
public String getLiveNodes()
```
    Returned information is a JSON representation of map with host name as the key and value is a map of live node attribute keys to its values
    
    Specified by:
    
    getLiveNodes in interface NameNodeMXBean
    
    Returns:
    the live node information
  - getDeadNodes
```
public String getDeadNodes()
```
    Returned information is a JSON representation of map with host name as the key and value is a map of dead node attribute keys to its values
    
    Specified by:
    
    getDeadNodes in interface NameNodeMXBean
    
    Returns:
    the dead node information
  - getDecomNodes
```
public String getDecomNodes()
```
    Returned information is a JSON representation of map with host name as the key and value is a map of decomisioning node attribute keys to its values
    
    Specified by:
    
    getDecomNodes in interface NameNodeMXBean
    
    Returns:
    the decommissioning node information
  - getClusterId
```
public String getClusterId()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the cluster id.
    
    Specified by:
    
    getClusterId in interface NameNodeMXBean
    
    Returns:
    the cluster id
  - getBlockPoolId
```
public String getBlockPoolId()
```
    Description copied from interface: NameNodeMXBean
    
    Gets the block pool id.
    
    Specified by:
    
    getBlockPoolId in interface NameNodeMXBean
    
    Specified by:
    
    getBlockPoolId in interface Namesystem
    
    Returns:
    the block pool ID
  - getNameDirStatuses
```
public String getNameDirStatuses()
```
    Description copied from interface: NameNodeMXBean
    
    Get status information about the directories storing image and edits logs of the NN.
    
    Specified by:
    
    getNameDirStatuses in interface NameNodeMXBean
    
    Returns:
    the name dir status information, as a JSON string.
  - getJournalTransactionInfo
```
public String getJournalTransactionInfo()
```
    Description copied from interface: NameNodeMXBean
    
    Get information about the transaction ID, including the last applied transaction ID and the most recent checkpoint's transaction ID
    
    Specified by:
    
    getJournalTransactionInfo in interface NameNodeMXBean
  - getBlockManager
```
public BlockManager getBlockManager()
```
    Returns:
    the block manager.
  - getFSDirectory
```
public FSDirectory getFSDirectory()
```
    Returns:
    the FSDirectory.
  - getDistinctVersionCount
```
public int getDistinctVersionCount()
```
    Description copied from interface: NameNodeMXBean
    
    Get the number of distinct versions of live datanodes
    
    Specified by:
    
    getDistinctVersionCount in interface NameNodeMXBean
    
    Returns:
    the number of distinct versions of live datanodes
  - getDistinctVersions
```
public Map<String,Integer> getDistinctVersions()
```
    Description copied from interface: NameNodeMXBean
    
    Get the number of live datanodes for each distinct versions
    
    Specified by:
    
    getDistinctVersions in interface NameNodeMXBean
    
    Returns:
    the number of live datanodes for each distinct versions
  - getSoftwareVersion
```
public String getSoftwareVersion()
```
    Description copied from interface: NameNodeMXBean
    
    Get the version of software running on the Namenode
    
    Specified by:
    
    getSoftwareVersion in interface NameNodeMXBean
    
    Returns:
    a string representing the version
  - verifyToken
```
public void verifyToken(DelegationTokenIdentifier identifier,
               byte[] password)
                 throws SecretManager.InvalidToken
```
    Verifies that the given identifier and password are valid and match.
    
    Parameters:
    identifier - Token identifier.
    password - Password in the token.
    
    Throws:
    
    SecretManager.InvalidToken
  - isGenStampInFuture
```
public boolean isGenStampInFuture(Block block)
```
    Specified by:
    
    isGenStampInFuture in interface Namesystem
  - getEditLogTailer
```
public EditLogTailer getEditLogTailer()
```
  - getSafeModeInfoForTests
```
public org.apache.hadoop.hdfs.server.namenode.FSNamesystem.SafeModeInfo getSafeModeInfoForTests()
```
  - setNNResourceChecker
```
public void setNNResourceChecker(NameNodeResourceChecker nnResourceChecker)
```
  - isAvoidingStaleDataNodesForWrite
```
public boolean isAvoidingStaleDataNodesForWrite()
```
    Description copied from interface: FSClusterStats
    
    Indicate whether or not the cluster is now avoiding to use stale DataNodes for writing.
    
    Specified by:
    
    isAvoidingStaleDataNodesForWrite in interface FSClusterStats
    
    Returns:
    True if the cluster is currently avoiding using stale DataNodes for writing targets, and false otherwise.
  - getSnapshotManager
```
public SnapshotManager getSnapshotManager()
```
  - getSnapshottableDirListing
```
public SnapshottableDirectoryStatus[] getSnapshottableDirListing()
                                                          throws IOException
```
    Get the list of snapshottable directories that are owned by the current user. Return all the snapshottable directories if the current user is a super user.
    
    Returns:
    The list of all the current snapshottable directories
    
    Throws:
    
    IOException

Class FSNamesystem

Field Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

LOG

auditLog

Method Detail

isAuditEnabled

resetLastInodeId

getLastInodeId

allocateNewInodeId

loadFromDisk

getRetryCache

checkOperation

getNamespaceDirs

getRequiredNamespaceEditsDirs

getNamespaceEditsDirs

getNamespaceEditsDirs

getSharedEditsDirs

readLock

readUnlock

writeLock

writeLockInterruptibly

writeUnlock

hasWriteLock

hasReadLock

hasReadOrWriteLock

isRunning

isInStandbyState

getFSImage

getEditLog

getMissingBlocksCount

getExpiredHeartbeats

getTransactionsSinceLastCheckpoint

getTransactionsSinceLastLogRoll

getLastWrittenTransactionId

getLastCheckpointTime

getCapacityTotal

getCapacityTotalGB

getCapacityUsed

getCapacityUsedGB

getCapacityRemaining

getCapacityRemainingGB

getCapacityUsedNonDFS

getTotalLoad

getNumSnapshottableDirs

getNumSnapshots

checkSafeMode

isInSafeMode

isInStartupSafeMode

isPopulatingReplQueues

incrementSafeBlockCount

decrementSafeBlockCount

adjustSafeModeBlockTotals

setBlockTotal

getBlocksTotal

processIncrementalBlockReport

checkSuperuserPrivilege

getFilesTotal

getPendingReplicationBlocks

getUnderReplicatedBlocks

getCorruptReplicaBlocks

getScheduledReplicationBlocks

getPendingDeletionBlocks

getExcessBlocks

getPostponedMisreplicatedBlocks

getPendingDataNodeMessageCount

getHAState

getMillisSinceLastLoadedEdits

getBlockCapacity

getFSState

getNumLiveDataNodes

getNumDeadDataNodes

getNumStaleDataNodes

logUpdateMasterKey

logExpireDelegationToken

getVersion

getUsed

getFree