Package com.aquima.interactions.matching.impl.functions.fulltext

Class StreamTokenizer

java.lang.Object

com.aquima.interactions.matching.impl.functions.fulltext.StreamTokenizer

public class StreamTokenizer
extends Object

Simple tokenizer that parses a string into a list of words. Words containing special characters or digits are ignored.

Since:

6.2

Author:

O. Kerpershoek, F. van der Meer

Constructor Summary

Constructors

Constructor	Description
StreamTokenizer(Reader reader)	Constructs the tokenizer with the reader providing the input.

Method Summary

Modifier and Type	Method	Description
String[]	getWords()	This method returns an array containing the words that were parsed from the reader.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamTokenizer

public StreamTokenizer(Reader reader)
                throws IOException

Constructs the tokenizer with the reader providing the input.

Parameters:

reader - The reader providing the string that should be parsed.

Throws:

IOException - This exception is thrown when the reader could not be accessed.

Method Detail

getWords

public String[] getWords()

This method returns an array containing the words that were parsed from the reader.

Returns:

an array containing the words that were parsed from the reader.