opennlp.tools.namefind

Class NameFinderEventStream

java.lang.Object

opennlp.model.AbstractEventStream

opennlp.tools.util.AbstractEventStream<NameSample>

opennlp.tools.namefind.NameFinderEventStream

All Implemented Interfaces:

EventStream

public class NameFinderEventStream
extends AbstractEventStream<NameSample>

Class for creating an event stream out of data files for training an name finder.

Constructor Summary

Constructors

Constructor and Description
NameFinderEventStream(ObjectStream<NameSample> dataStream)
NameFinderEventStream(ObjectStream<NameSample> dataStream, String type, NameContextGenerator contextGenerator) Creates a new name finder event stream using the specified data stream and context generator.

Method Summary

Modifier and Type	Method and Description
static String[][]	additionalContext(String[] tokens, Map<String,String> prevMap) Generated previous decision features for each token based on contents of the specified map.
protected Iterator<Event>	createEvents(NameSample sample) Creates events for the provided sample.
static List<Event>	generateEvents(String[] sentence, String[] outcomes, NameContextGenerator cg)
static String[]	generateOutcomes(Span[] names, String type, int length) Generates the name tag outcomes (start, continue, other) for each token in a sentence with the specified length using the specified name spans.
static void	main(String[] args) Deprecated.

Methods inherited from class opennlp.tools.util.AbstractEventStream

hasNext, next

Methods inherited from class opennlp.model.AbstractEventStream

remove

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NameFinderEventStream

public NameFinderEventStream(ObjectStream<NameSample> dataStream,
                             String type,
                             NameContextGenerator contextGenerator)

Creates a new name finder event stream using the specified data stream and context generator.

Parameters:

dataStream - The data stream of events.

type - null or overrides the type parameter in the provided samples

contextGenerator - The context generator used to generate features for the event stream.

NameFinderEventStream

public NameFinderEventStream(ObjectStream<NameSample> dataStream)

Method Detail

generateOutcomes

public static String[] generateOutcomes(Span[] names,
                                        String type,
                                        int length)

Generates the name tag outcomes (start, continue, other) for each token in a sentence with the specified length using the specified name spans.

Parameters:

names - Token spans for each of the names.

type - null or overrides the type parameter in the provided samples

length - The length of the sentence.

Returns:

An array of start, continue, other outcomes based on the specified names and sentence length.

generateEvents

public static List<Event> generateEvents(String[] sentence,
                                         String[] outcomes,
                                         NameContextGenerator cg)

createEvents

protected Iterator<Event> createEvents(NameSample sample)

Description copied from class: AbstractEventStream

Creates events for the provided sample.

Specified by:

createEvents in class AbstractEventStream<NameSample>

Parameters:

sample - the sample for which training Events are be created.

Returns:

an Iterator of training events or an empty Iterator.

additionalContext

public static String[][] additionalContext(String[] tokens,
                                           Map<String,String> prevMap)

Generated previous decision features for each token based on contents of the specified map.

Parameters:

tokens - The token for which the context is generated.

prevMap - A mapping of tokens to their previous decisions.

Returns:

An additional context array with features for each token.

main

@Deprecated
public static final void main(String[] args)
                                   throws IOException

Deprecated.

Throws:

IOException