org.apache.hadoop.hive.ql

Class QTestUtil

java.lang.Object

org.apache.hadoop.hive.ql.QTestUtil

Direct Known Subclasses:

TestLocationQueries.CheckResults

public class QTestUtil
extends java.lang.Object

QTestUtil.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	QTestUtil.QTestSetup QTestSetup defines test fixtures which are reused across testcases, and are needed before any test can be run
static class	QTestUtil.QTRunner QTRunner: Runnable class for running a a single query file.

Field Summary

Fields

Modifier and Type	Field and Description
protected HiveConf	conf
protected java.lang.String	logDir
protected java.lang.String	outDir
protected boolean	overWrite
static java.util.HashSet<java.lang.String>	srcTables

Constructor Summary

Constructors

Constructor and Description
QTestUtil(java.lang.String outDir, java.lang.String logDir)
QTestUtil(java.lang.String outDir, java.lang.String logDir, boolean miniMr, java.lang.String hadoopVer)

Method Summary

Modifier and Type	Method and Description
void	addFile(java.io.File qf)
void	addFile(java.lang.String qFile)
java.util.List<Task<? extends java.io.Serializable>>	analyzeAST(ASTNode ast)
int	checkCliDriverResults(java.lang.String tname)
int	checkNegativeResults(java.lang.String tname, java.lang.Exception e)
int	checkParseResults(java.lang.String tname, ASTNode tree)
int	checkPlan(java.lang.String tname, java.util.List<Task<? extends java.io.Serializable>> tasks)
void	cleanUp()
void	clearPostTestEffects() Clear out any side effects of running tests
void	clearTestSideEffects() Clear out any side effects of running tests
void	cliInit(java.lang.String tname)
void	cliInit(java.lang.String tname, boolean recreate)
void	convertSequenceFileToTextFile()
void	copyDirectoryToLocal(Path src, Path dest)
void	createSources()
boolean	deleteDirectory(java.io.File path)
int	execute(java.lang.String tname)
int	executeClient(java.lang.String tname)
int	executeOne(java.lang.String tname)
java.lang.String	getLogDirectory()
java.lang.String	getOutputDirectory()
java.util.TreeMap<java.lang.String,java.lang.String>	getQMap()
void	init()
void	init(java.lang.String tname)
void	initConf()
void	normalizeNames(java.io.File path)
java.lang.String	outPath(java.lang.String outDir, java.lang.String testName) Given the current configurations (e.g., hadoop version and execution mode), return the correct file name to compare with the current test run output.
static void	outputTestFailureHelpMessage()
ASTNode	parseQuery(java.lang.String tname)
static boolean	queryListRunnerMultiThreaded(java.io.File[] qfiles, QTestUtil[] qt) Executes a set of query files parallel.
static QTestUtil[]	queryListRunnerSetup(java.io.File[] qfiles, java.lang.String resDir, java.lang.String logDir) Setup to execute a set of query files.
static boolean	queryListRunnerSingleThreaded(java.io.File[] qfiles, QTestUtil[] qt) Executes a set of query files in sequence.
void	resetParser()
boolean	shouldBeSkipped(java.lang.String tname)
void	shutdown()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

outDir

protected final java.lang.String outDir

logDir

protected final java.lang.String logDir

srcTables

public static final java.util.HashSet<java.lang.String> srcTables

conf

protected HiveConf conf

overWrite

protected final boolean overWrite

Constructor Detail

QTestUtil

public QTestUtil(java.lang.String outDir,
                 java.lang.String logDir)
          throws java.lang.Exception

Throws:

java.lang.Exception

QTestUtil

public QTestUtil(java.lang.String outDir,
                 java.lang.String logDir,
                 boolean miniMr,
                 java.lang.String hadoopVer)
          throws java.lang.Exception

Throws:

java.lang.Exception

Method Detail

deleteDirectory

public boolean deleteDirectory(java.io.File path)

copyDirectoryToLocal

public void copyDirectoryToLocal(Path src,
                                 Path dest)
                          throws java.lang.Exception

Throws:

java.lang.Exception

normalizeNames

public void normalizeNames(java.io.File path)
                    throws java.lang.Exception

Throws:

java.lang.Exception

getOutputDirectory

public java.lang.String getOutputDirectory()

getLogDirectory

public java.lang.String getLogDirectory()

initConf

public void initConf()
              throws java.lang.Exception

Throws:

java.lang.Exception

shutdown

public void shutdown()
              throws java.lang.Exception

Throws:

java.lang.Exception

addFile

public void addFile(java.lang.String qFile)
             throws java.lang.Exception

Throws:

java.lang.Exception

addFile

public void addFile(java.io.File qf)
             throws java.lang.Exception

Throws:

java.lang.Exception

clearPostTestEffects

public void clearPostTestEffects()
                          throws java.lang.Exception

Clear out any side effects of running tests

Throws:

java.lang.Exception

clearTestSideEffects

public void clearTestSideEffects()
                          throws java.lang.Exception

Clear out any side effects of running tests

Throws:

java.lang.Exception

cleanUp

public void cleanUp()
             throws java.lang.Exception

Throws:

java.lang.Exception

createSources

public void createSources()
                   throws java.lang.Exception

Throws:

java.lang.Exception

init

public void init()
          throws java.lang.Exception

Throws:

java.lang.Exception

init

public void init(java.lang.String tname)
          throws java.lang.Exception

Throws:

java.lang.Exception

cliInit

public void cliInit(java.lang.String tname)
             throws java.lang.Exception

Throws:

java.lang.Exception

cliInit

public void cliInit(java.lang.String tname,
                    boolean recreate)
             throws java.lang.Exception

Throws:

java.lang.Exception

executeOne

public int executeOne(java.lang.String tname)

execute

public int execute(java.lang.String tname)

executeClient

public int executeClient(java.lang.String tname)

shouldBeSkipped

public boolean shouldBeSkipped(java.lang.String tname)

convertSequenceFileToTextFile

public void convertSequenceFileToTextFile()
                                   throws java.lang.Exception

Throws:

java.lang.Exception

checkNegativeResults

public int checkNegativeResults(java.lang.String tname,
                                java.lang.Exception e)
                         throws java.lang.Exception

Throws:

java.lang.Exception

checkParseResults

public int checkParseResults(java.lang.String tname,
                             ASTNode tree)
                      throws java.lang.Exception

Throws:

java.lang.Exception

checkPlan

public int checkPlan(java.lang.String tname,
                     java.util.List<Task<? extends java.io.Serializable>> tasks)
              throws java.lang.Exception

Throws:

java.lang.Exception

outPath

public java.lang.String outPath(java.lang.String outDir,
                                java.lang.String testName)

Given the current configurations (e.g., hadoop version and execution mode), return the correct file name to compare with the current test run output.

Parameters:

outDir - The directory where the reference log files are stored.

testName - The test file name (terminated by ".out").

Returns:

The file name appended with the configuration values if it exists.

checkCliDriverResults

public int checkCliDriverResults(java.lang.String tname)
                          throws java.lang.Exception

Throws:

java.lang.Exception

parseQuery

public ASTNode parseQuery(java.lang.String tname)
                   throws java.lang.Exception

Throws:

java.lang.Exception

resetParser

public void resetParser()
                 throws SemanticException

Throws:

SemanticException

analyzeAST

public java.util.List<Task<? extends java.io.Serializable>> analyzeAST(ASTNode ast)
                                                                throws java.lang.Exception

Throws:

java.lang.Exception

getQMap

public java.util.TreeMap<java.lang.String,java.lang.String> getQMap()

queryListRunnerSetup

public static QTestUtil[] queryListRunnerSetup(java.io.File[] qfiles,
                                               java.lang.String resDir,
                                               java.lang.String logDir)
                                        throws java.lang.Exception

Setup to execute a set of query files. Uses QTestUtil to do so.

Parameters:

qfiles - array of input query files containing arbitrary number of hive queries

resDir - output directory

logDir - log directory

Returns:

one QTestUtil for each query file

Throws:

java.lang.Exception

queryListRunnerSingleThreaded

public static boolean queryListRunnerSingleThreaded(java.io.File[] qfiles,
                                                    QTestUtil[] qt)
                                             throws java.lang.Exception

Executes a set of query files in sequence.

Parameters:

qfiles - array of input query files containing arbitrary number of hive queries

qt - array of QTestUtils, one per qfile

Returns:

true if all queries passed, false otw

Throws:

java.lang.Exception

queryListRunnerMultiThreaded

public static boolean queryListRunnerMultiThreaded(java.io.File[] qfiles,
                                                   QTestUtil[] qt)
                                            throws java.lang.Exception

Executes a set of query files parallel. Each query file is run in a separate thread. The caller has to arrange that different query files do not collide (in terms of destination tables)

Parameters:

qfiles - array of input query files containing arbitrary number of hive queries

qt - array of QTestUtils, one per qfile

Returns:

true if all queries passed, false otw

Throws:

java.lang.Exception

outputTestFailureHelpMessage

public static void outputTestFailureHelpMessage()