org.apache.hadoop.hive.metastore

Class Warehouse

java.lang.Object

org.apache.hadoop.hive.metastore.Warehouse

public class Warehouse
extends java.lang.Object

This class represents a warehouse where data of Hive tables is stored

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.commons.logging.Log	LOG

Constructor Summary

Constructors

Constructor and Description
Warehouse(Configuration conf)

Method Summary

Modifier and Type	Method and Description
static void	closeFs(FileSystem fs)
boolean	deleteDir(Path f, boolean recursive)
Path	getDatabasePath(Database db)
Path	getDefaultDatabasePath(java.lang.String dbName)
Path	getDnsPath(Path path) Hadoop File System reverse lookups paths with raw ip addresses The File System URI always contains the canonical DNS name of the Namenode.
FileSystem	getFs(Path f) Helper functions to convert IOException to MetaException
Path	getPartitionPath(Database db, java.lang.String tableName, java.util.LinkedHashMap<java.lang.String,java.lang.String> pm)
Path	getPartitionPath(Path tblPath, java.util.LinkedHashMap<java.lang.String,java.lang.String> pm)
static java.util.List<java.lang.String>	getPartValuesFromPartName(java.lang.String partName)
Path	getTablePath(Database db, java.lang.String tableName)
Path	getTablePath(java.lang.String whRootString, java.lang.String tableName)
Path	getWhRoot() Resolve the configured warehouse root dir with respect to the configuration This involves opening the FileSystem corresponding to the warehouse root dir (but that should be ok given that this is only called during DDL statements for non-external tables).
boolean	isDir(Path f)
boolean	isWritable(Path path)
static java.lang.String	makeDynamicPartName(java.util.Map<java.lang.String,java.lang.String> spec) Given a dynamic partition specification, return the path corresponding to the static part of partition specification.
static java.util.Map<java.lang.String,java.lang.String>	makeEscSpecFromName(java.lang.String name)
static java.lang.String	makePartName(java.util.List<FieldSchema> partCols, java.util.List<java.lang.String> vals)
static java.lang.String	makePartName(java.util.List<FieldSchema> partCols, java.util.List<java.lang.String> vals, java.lang.String defaultStr) Makes a valid partition name.
static java.lang.String	makePartName(java.util.Map<java.lang.String,java.lang.String> spec, boolean addTrailingSeperator) Makes a partition name from a specification
static java.lang.String	makePartPath(java.util.Map<java.lang.String,java.lang.String> spec) Given a partition specification, return the path corresponding to the partition spec.
static void	makeSpecFromName(java.util.Map<java.lang.String,java.lang.String> partSpec, Path currPath)
static java.util.LinkedHashMap<java.lang.String,java.lang.String>	makeSpecFromName(java.lang.String name)
boolean	mkdirs(Path f)
boolean	renameDir(Path sourcePath, Path destPath)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final org.apache.commons.logging.Log LOG

Constructor Detail

Warehouse

public Warehouse(Configuration conf)
          throws MetaException

Throws:

MetaException

Method Detail

getFs

public FileSystem getFs(Path f)
                 throws MetaException

Helper functions to convert IOException to MetaException

Throws:

MetaException

closeFs

public static void closeFs(FileSystem fs)
                    throws MetaException

Throws:

MetaException

getDnsPath

public Path getDnsPath(Path path)
                throws MetaException

Hadoop File System reverse lookups paths with raw ip addresses The File System URI always contains the canonical DNS name of the Namenode. Subsequently, operations on paths with raw ip addresses cause an exception since they don't match the file system URI. This routine solves this problem by replacing the scheme and authority of a path with the scheme and authority of the FileSystem that it maps to.

Parameters:

path - Path to be canonicalized

Returns:

Path with canonical scheme and authority

Throws:

MetaException

getWhRoot

public Path getWhRoot()
               throws MetaException

Resolve the configured warehouse root dir with respect to the configuration This involves opening the FileSystem corresponding to the warehouse root dir (but that should be ok given that this is only called during DDL statements for non-external tables).

Throws:

MetaException

getTablePath

public Path getTablePath(java.lang.String whRootString,
                         java.lang.String tableName)
                  throws MetaException

Throws:

MetaException

getDatabasePath

public Path getDatabasePath(Database db)
                     throws MetaException

Throws:

MetaException

getDefaultDatabasePath

public Path getDefaultDatabasePath(java.lang.String dbName)
                            throws MetaException

Throws:

MetaException

getTablePath

public Path getTablePath(Database db,
                         java.lang.String tableName)
                  throws MetaException

Throws:

MetaException

mkdirs

public boolean mkdirs(Path f)
               throws MetaException

Throws:

MetaException

renameDir

public boolean renameDir(Path sourcePath,
                         Path destPath)
                  throws MetaException

Throws:

MetaException

deleteDir

public boolean deleteDir(Path f,
                         boolean recursive)
                  throws MetaException

Throws:

MetaException

isWritable

public boolean isWritable(Path path)
                   throws java.io.IOException

Throws:

java.io.IOException

makePartPath

public static java.lang.String makePartPath(java.util.Map<java.lang.String,java.lang.String> spec)
                                     throws MetaException

Given a partition specification, return the path corresponding to the partition spec. By default, the specification does not include dynamic partitions.

Parameters:

spec -

Returns:

string representation of the partition specification.

Throws:

MetaException

makePartName

public static java.lang.String makePartName(java.util.Map<java.lang.String,java.lang.String> spec,
                                            boolean addTrailingSeperator)
                                     throws MetaException

Makes a partition name from a specification

Parameters:

spec -

addTrailingSeperator - if true, adds a trailing separator e.g. 'ds=1/'

Returns:

partition name

Throws:

MetaException

makeDynamicPartName

public static java.lang.String makeDynamicPartName(java.util.Map<java.lang.String,java.lang.String> spec)

Given a dynamic partition specification, return the path corresponding to the static part of partition specification. This is basically a copy of makePartName but we get rid of MetaException since it is not serializable.

Parameters:

spec -

Returns:

string representation of the static part of the partition specification.

makeSpecFromName

public static java.util.LinkedHashMap<java.lang.String,java.lang.String> makeSpecFromName(java.lang.String name)
                                                                                   throws MetaException

Throws:

MetaException

makeSpecFromName

public static void makeSpecFromName(java.util.Map<java.lang.String,java.lang.String> partSpec,
                                    Path currPath)

makeEscSpecFromName

public static java.util.Map<java.lang.String,java.lang.String> makeEscSpecFromName(java.lang.String name)
                                                                            throws MetaException

Throws:

MetaException

getPartitionPath

public Path getPartitionPath(Database db,
                             java.lang.String tableName,
                             java.util.LinkedHashMap<java.lang.String,java.lang.String> pm)
                      throws MetaException

Throws:

MetaException

getPartitionPath

public Path getPartitionPath(Path tblPath,
                             java.util.LinkedHashMap<java.lang.String,java.lang.String> pm)
                      throws MetaException

Throws:

MetaException

isDir

public boolean isDir(Path f)
              throws MetaException

Throws:

MetaException

makePartName

public static java.lang.String makePartName(java.util.List<FieldSchema> partCols,
                                            java.util.List<java.lang.String> vals)
                                     throws MetaException

Throws:

MetaException

makePartName

public static java.lang.String makePartName(java.util.List<FieldSchema> partCols,
                                            java.util.List<java.lang.String> vals,
                                            java.lang.String defaultStr)
                                     throws MetaException

Makes a valid partition name.

Parameters:

partCols - The partition columns

vals - The partition values

defaultStr - The default name given to a partition value if the respective value is empty or null.

Returns:

An escaped, valid partition name.

Throws:

MetaException

getPartValuesFromPartName

public static java.util.List<java.lang.String> getPartValuesFromPartName(java.lang.String partName)
                                                                  throws MetaException

Throws:

MetaException