opennlp.uima.tokenize

Class SimpleTokenizer

java.lang.Object

org.apache.uima.analysis_component.AnalysisComponent_ImplBase

org.apache.uima.analysis_component.Annotator_ImplBase

org.apache.uima.analysis_component.CasAnnotator_ImplBase

opennlp.uima.tokenize.AbstractTokenizer

opennlp.uima.tokenize.SimpleTokenizer

All Implemented Interfaces:

org.apache.uima.analysis_component.AnalysisComponent

public final class SimpleTokenizer
extends AbstractTokenizer

OpenNLP Simple Tokenizer annotator.

Mandatory parameters

Type	Name	Description
String	opennlp.uima.SentenceType	The full name of the sentence type
String	opennlp.uima.TokenType	The full name of the token type

Field Summary

Fields inherited from class opennlp.uima.tokenize.AbstractTokenizer

context, logger, name, sentenceType, tokenType

Constructor Summary

Constructors

Constructor and Description
SimpleTokenizer() Initializes the current instance.

Method Summary

Modifier and Type	Method and Description
protected Span[]	tokenize(org.apache.uima.cas.CAS cas, org.apache.uima.cas.text.AnnotationFS sentence)

Methods inherited from class opennlp.uima.tokenize.AbstractTokenizer

initialize, postProcessAnnotations, process, typeSystemInit

Methods inherited from class org.apache.uima.analysis_component.CasAnnotator_ImplBase

getRequiredCasInterface, process

Methods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase

getCasInstancesRequired, hasNext, next

Methods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase

batchProcessComplete, collectionProcessComplete, destroy, getContext, getResultSpecification, reconfigure, setResultSpecification

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleTokenizer

public SimpleTokenizer()

Initializes the current instance. Note: Use AbstractTokenizer.initialize(UimaContext) to initialize this instance. Not use the constructor.

Method Detail

tokenize

protected Span[] tokenize(org.apache.uima.cas.CAS cas,
                          org.apache.uima.cas.text.AnnotationFS sentence)

Specified by:

tokenize in class AbstractTokenizer