public class SimpleTokenizer extends java.lang.Object implements TextTokenizer
| Constructor and Description |
|---|
SimpleTokenizer() |
| Modifier and Type | Method and Description |
|---|---|
java.util.List<java.lang.String> |
expand(java.lang.String text)
Cleans the text and returns the list of lines
|
public java.util.List<java.lang.String> expand(java.lang.String text)
TextTokenizerexpand in interface TextTokenizertext - Input text