tachyon.worker

Class WorkerStorage

java.lang.Object

tachyon.worker.WorkerStorage

public class WorkerStorage
extends Object

The structure to store a worker's information in worker node.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	WorkerStorage.CheckpointThread The CheckpointThread, used to checkpoint the files belong to the worker.

Constructor Summary

Constructors

Constructor and Description
WorkerStorage(InetSocketAddress masterAddress, InetSocketAddress workerAddress, String dataFolder, long memoryCapacityBytes)

Method Summary

Modifier and Type	Method and Description
void	accessBlock(long blockId) Update the latest block access time on the worker.
void	addCheckpoint(long userId, int fileId) Add the checkpoint information of a file.
boolean	asyncCheckpoint(int fileId) Notify the worker to checkpoint the file asynchronously.
void	cacheBlock(long userId, long blockId) Notify the worker the block is cached.
void	checkStatus() Check worker's status.
void	freeBlocks(List<Long> blocks) Remove blocks from the memory.
String	getDataFolder()
String	getUnderfsOrphansFolder()
String	getUserTempFolder(long userId) Get the local user temporary folder of the specified user.
String	getUserUnderfsTempFolder(long userId) Get the user temporary folder in the under file system of the specified user.
Command	heartbeat() Heartbeat with the TachyonMaster.
void	lockBlock(long blockId, long userId) Lock the block
void	register() Register this TachyonWorker to the TachyonMaster
boolean	requestSpace(long userId, long requestBytes) Request space from the worker
void	resetMasterClient() Set a new MasterClient and connect to it.
void	returnSpace(long userId, long returnedBytes) Return the space which has been requested
void	stop() Disconnect to the Master.
void	unlockBlock(long blockId, long userId) Unlock the block
void	userHeartbeat(long userId) Handle the user's heartbeat.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WorkerStorage

public WorkerStorage(InetSocketAddress masterAddress,
                     InetSocketAddress workerAddress,
                     String dataFolder,
                     long memoryCapacityBytes)

Parameters:

masterAddress - The TachyonMaster's address

workerAddress - This TachyonWorker's address

dataFolder - This TachyonWorker's local folder's path

memoryCapacityBytes - The maximum memory space this TachyonWorker can use, in bytes

Method Detail

accessBlock

public void accessBlock(long blockId)

Update the latest block access time on the worker.

Parameters:

blockId - The id of the block

addCheckpoint

public void addCheckpoint(long userId,
                          int fileId)
                   throws FileDoesNotExistException,
                          SuspectedFileSizeException,
                          FailedToCheckpointException,
                          BlockInfoException,
                          org.apache.thrift.TException

Add the checkpoint information of a file. The information is from the user userId.

Parameters:

userId - The user id of the client who send the notification

fileId - The id of the checkpointed file

Throws:

FileDoesNotExistException

SuspectedFileSizeException

FailedToCheckpointException

BlockInfoException

org.apache.thrift.TException

asyncCheckpoint

public boolean asyncCheckpoint(int fileId)
                        throws IOException,
                               org.apache.thrift.TException

Notify the worker to checkpoint the file asynchronously.

Parameters:

fileId - The id of the file

Returns:

true if succeed, false otherwise

Throws:

IOException

org.apache.thrift.TException

cacheBlock

public void cacheBlock(long userId,
                       long blockId)
                throws FileDoesNotExistException,
                       SuspectedFileSizeException,
                       BlockInfoException,
                       org.apache.thrift.TException

Notify the worker the block is cached.

Parameters:

userId - The user id of the client who send the notification

blockId - The id of the block

Throws:

FileDoesNotExistException

SuspectedFileSizeException

BlockInfoException

org.apache.thrift.TException

checkStatus

public void checkStatus()

Check worker's status. This should be executed periodically.

It finds the timeout users and cleans them up.

freeBlocks

public void freeBlocks(List<Long> blocks)

Remove blocks from the memory.

Parameters:

blocks - The list of blocks to be removed.

getDataFolder

public String getDataFolder()
                     throws org.apache.thrift.TException

Returns:

The root local data folder of the worker

Throws:

org.apache.thrift.TException

getUnderfsOrphansFolder

public String getUnderfsOrphansFolder()

Returns:

The orphans' folder in the under file system

getUserTempFolder

public String getUserTempFolder(long userId)
                         throws org.apache.thrift.TException

Get the local user temporary folder of the specified user.

Parameters:

userId - The id of the user

Returns:

The local user temporary folder of the specified user

Throws:

org.apache.thrift.TException

getUserUnderfsTempFolder

public String getUserUnderfsTempFolder(long userId)
                                throws org.apache.thrift.TException

Get the user temporary folder in the under file system of the specified user.

Parameters:

userId - The id of the user

Returns:

The user temporary folder in the under file system

Throws:

org.apache.thrift.TException

heartbeat

public Command heartbeat()
                  throws BlockInfoException,
                         org.apache.thrift.TException

Heartbeat with the TachyonMaster. Send the removed block list to the Master.

Returns:

The Command received from the Master

Throws:

BlockInfoException

org.apache.thrift.TException

lockBlock

public void lockBlock(long blockId,
                      long userId)
               throws org.apache.thrift.TException

Lock the block

Parameters:

blockId - The id of the block

userId - The id of the user who locks the block

Throws:

org.apache.thrift.TException

register

public void register()

Register this TachyonWorker to the TachyonMaster

requestSpace

public boolean requestSpace(long userId,
                            long requestBytes)
                     throws org.apache.thrift.TException

Request space from the worker

Parameters:

userId - The id of the user who send the request

requestBytes - The requested space size, in bytes

Returns:

true if succeed, false otherwise

Throws:

org.apache.thrift.TException

resetMasterClient

public void resetMasterClient()
                       throws org.apache.thrift.TException

Set a new MasterClient and connect to it.

Throws:

org.apache.thrift.TException

returnSpace

public void returnSpace(long userId,
                        long returnedBytes)
                 throws org.apache.thrift.TException

Return the space which has been requested

Parameters:

userId - The id of the user who wants to return the space

returnedBytes - The returned space size, in bytes

Throws:

org.apache.thrift.TException

stop

public void stop()

Disconnect to the Master.

unlockBlock

public void unlockBlock(long blockId,
                        long userId)
                 throws org.apache.thrift.TException

Unlock the block

Parameters:

blockId - The id of the block

userId - The id of the user who unlocks the block

Throws:

org.apache.thrift.TException

userHeartbeat

public void userHeartbeat(long userId)
                   throws org.apache.thrift.TException

Handle the user's heartbeat.

Parameters:

userId - The id of the user

Throws:

org.apache.thrift.TException