Package org.apache.lucene.analysis.en
Class EnglishAnalyzer
java.lang.Object
org.apache.lucene.analysis.Analyzer
org.apache.lucene.analysis.StopwordAnalyzerBase
org.apache.lucene.analysis.en.EnglishAnalyzer
- All Implemented Interfaces:
Closeable,AutoCloseable
Analyzer for English.- Since:
- 3.1
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.lucene.analysis.Analyzer
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents -
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final CharArraySetAn unmodifiable set containing some common English words that are not usually useful for searching.Fields inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
stopwordsFields inherited from class org.apache.lucene.analysis.Analyzer
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY -
Constructor Summary
ConstructorsConstructorDescriptionBuilds an analyzer with the default stop words:getDefaultStopSet().EnglishAnalyzer(CharArraySet stopwords) Builds an analyzer with the given stop words.EnglishAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet) Builds an analyzer with the given stop words. -
Method Summary
Modifier and TypeMethodDescriptionprotected Analyzer.TokenStreamComponentscreateComponents(String fieldName) Creates aAnalyzer.TokenStreamComponentswhich tokenizes all the text in the providedReader.static CharArraySetReturns an unmodifiable instance of the default stop words set.protected TokenStreamnormalize(String fieldName, TokenStream in) Methods inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
getStopwordSet, loadStopwordSet, loadStopwordSetMethods inherited from class org.apache.lucene.analysis.Analyzer
attributeFactory, close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, initReader, initReaderForNormalization, normalize, tokenStream, tokenStream
-
Field Details
-
ENGLISH_STOP_WORDS_SET
An unmodifiable set containing some common English words that are not usually useful for searching.
-
-
Constructor Details
-
EnglishAnalyzer
public EnglishAnalyzer()Builds an analyzer with the default stop words:getDefaultStopSet(). -
EnglishAnalyzer
Builds an analyzer with the given stop words.- Parameters:
stopwords- a stopword set
-
EnglishAnalyzer
Builds an analyzer with the given stop words. If a non-empty stem exclusion set is provided this analyzer will add aSetKeywordMarkerFilterbefore stemming.- Parameters:
stopwords- a stopword setstemExclusionSet- a set of terms not to be stemmed
-
-
Method Details
-
getDefaultStopSet
Returns an unmodifiable instance of the default stop words set.- Returns:
- default stop words set.
-
createComponents
Creates aAnalyzer.TokenStreamComponentswhich tokenizes all the text in the providedReader.- Specified by:
createComponentsin classAnalyzer- Returns:
- A
Analyzer.TokenStreamComponentsbuilt from anStandardTokenizerfiltered withEnglishPossessiveFilter,LowerCaseFilter,StopFilter,SetKeywordMarkerFilterif a stem exclusion set is provided andPorterStemFilter.
-
normalize
-