Uses of Class
org.apache.lucene.analysis.standard.StandardTokenizerImpl
Packages that use StandardTokenizerImpl
Package
Description
Fast, general-purpose grammar-based tokenizer
StandardTokenizer
implements the Word Break rules from the
Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.-
Uses of StandardTokenizerImpl in org.apache.lucene.analysis.standard
Fields in org.apache.lucene.analysis.standard declared as StandardTokenizerImplModifier and TypeFieldDescriptionprivate StandardTokenizerImpl
StandardTokenizer.scanner
A private instance of the JFlex-constructed scanner