Analyze a text and produce tokens
Analyze a text and produce tokens
input text
assumed text language
sequence of tokens
Lucene analyzer factory to use (defaults to LuceneTextAnalyzer)
Lucene analyzer factory to use (defaults to LuceneTextAnalyzer)
desired language
language specific language analyzer
Text analyzer implementation using a Lucene analyzer with HTML stripping applied