public final class BulgarianAnalyzer extends StopwordAnalyzerBase
Analyzer
for Bulgarian.
This analyzer implements light-stemming as specified by: Searching Strategies for the Bulgarian Language http://members.unine.ch/jacques.savoy/Papers/BUIR.pdf
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
DEFAULT_STOPWORD_FILE
File containing default Bulgarian stopwords.
|
stopwords
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
Constructor and Description |
---|
BulgarianAnalyzer()
Builds an analyzer with the default stop words:
DEFAULT_STOPWORD_FILE . |
BulgarianAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.
|
BulgarianAnalyzer(CharArraySet stopwords,
CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words and a stem exclusion set.
|
Modifier and Type | Method and Description |
---|---|
Analyzer.TokenStreamComponents |
createComponents(java.lang.String fieldName)
Creates a
Analyzer.TokenStreamComponents
which tokenizes all the text in the provided Reader . |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set.
|
protected TokenStream |
normalize(java.lang.String fieldName,
TokenStream in)
Wrap the given
TokenStream in order to apply normalization filters. |
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
attributeFactory, close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, getVersion, initReader, initReaderForNormalization, normalize, setVersion, tokenStream, tokenStream
public static final java.lang.String DEFAULT_STOPWORD_FILE
public BulgarianAnalyzer()
DEFAULT_STOPWORD_FILE
.public BulgarianAnalyzer(CharArraySet stopwords)
public BulgarianAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
SetKeywordMarkerFilter
before BulgarianStemFilter
.public static CharArraySet getDefaultStopSet()
public Analyzer.TokenStreamComponents createComponents(java.lang.String fieldName)
Analyzer.TokenStreamComponents
which tokenizes all the text in the provided Reader
.createComponents
in class Analyzer
fieldName
- the name of the fields content passed to the
Analyzer.TokenStreamComponents
sink as a readerAnalyzer.TokenStreamComponents
built from an StandardTokenizer
filtered with
LowerCaseFilter
, StopFilter
, SetKeywordMarkerFilter
if a stem exclusion set is
provided and BulgarianStemFilter
.protected TokenStream normalize(java.lang.String fieldName, TokenStream in)
Analyzer
TokenStream
in order to apply normalization filters.
The default implementation returns the TokenStream
as-is. This is
used by Analyzer.normalize(String, String)
.Copyright © 2000–2019 The Apache Software Foundation. All rights reserved.