TokenRangeSinkFilter and TeeSinkTokenFilter instead.public class TokenRangeSinkTokenizer extends SinkTokenizer
AttributeSource.AttributeFactory, AttributeSource.Stateiter, lst| Constructor and Description |
|---|
TokenRangeSinkTokenizer(int lower,
int upper)
Deprecated.
|
TokenRangeSinkTokenizer(int initCap,
int lower,
int upper)
Deprecated.
|
| Modifier and Type | Method and Description |
|---|---|
void |
add(Token t)
Deprecated.
Override this method to cache only certain tokens, or new tokens based
on the old tokens.
|
void |
reset()
Deprecated.
Reset the internal data structures to the start at the front of the list of tokens.
|
close, getTokens, nextcorrectOffset, resetend, getOnlyUseNewAPI, incrementToken, next, setOnlyUseNewAPIaddAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toStringpublic TokenRangeSinkTokenizer(int lower,
int upper)
public TokenRangeSinkTokenizer(int initCap,
int lower,
int upper)
public void add(Token t)
SinkTokenizeradd in class SinkTokenizert - The Token to add to the sinkpublic void reset()
throws IOException
SinkTokenizerSinkTokenizer.next(Token)reset in class SinkTokenizerIOExceptionCopyright © 2000-2012 Apache Software Foundation. All Rights Reserved.