org.apache.lucene.analysis

Class Tokenizer

public abstract class Tokenizer extends TokenStream

A Tokenizer is a TokenStream whose input is a Reader.

This is an abstract class.

Field Summary
protected Reader	input The text source for this Tokenizer.

Constructor Summary
protected	Tokenizer() Construct a tokenizer with null input.
protected	Tokenizer(Reader input) Construct a token stream processing the given input.

Method Summary
void	close() By default, closes the input Reader.

Field Detail

protected Reader input

The text source for this Tokenizer.

protected Tokenizer()

Construct a tokenizer with null input.

protected Tokenizer(Reader input)

Construct a token stream processing the given input.

public void close()

By default, closes the input Reader.