Package com.ibm.icu.impl.breakiter
Class CjkBreakEngine
java.lang.Object
com.ibm.icu.impl.breakiter.DictionaryBreakEngine
com.ibm.icu.impl.breakiter.CjkBreakEngine
- All Implemented Interfaces:
LanguageBreakEngine
-
Nested Class Summary
Nested classes/interfaces inherited from class com.ibm.icu.impl.breakiter.DictionaryBreakEngine
DictionaryBreakEngine.DequeI, DictionaryBreakEngine.PossibleWord
-
Field Summary
FieldsModifier and TypeFieldDescriptionprivate UnicodeSet
private DictionaryMatcher
private UnicodeSet
private UnicodeSet
private MlBreakEngine
private boolean
private static final int
private static final int
private static final int
private static final int
Fields inherited from class com.ibm.icu.impl.breakiter.DictionaryBreakEngine
fSet
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionint
divideUpDictionaryRange
(CharacterIterator inText, int startPos, int endPos, DictionaryBreakEngine.DequeI foundBreaks, boolean isPhraseBreaking) Divide up a range of known dictionary characters handled by this break engine.boolean
private static int
getKatakanaCost
(int wordlength) private String
getPatternFromText
(CharacterIterator text, StringBuffer sb, int start, int length) int
hashCode()
private void
private static boolean
isKatakana
(int value) private void
private void
Methods inherited from class com.ibm.icu.impl.breakiter.DictionaryBreakEngine
findBreaks, handles, setCharacters
-
Field Details
-
fHangulWordSet
-
fDigitOrOpenPunctuationOrAlphabetSet
-
fClosePunctuationSet
-
fDictionary
-
fSkipSet
-
fMlBreakEngine
-
isCj
private boolean isCj -
kMaxKatakanaLength
private static final int kMaxKatakanaLength- See Also:
-
kMaxKatakanaGroupLength
private static final int kMaxKatakanaGroupLength- See Also:
-
maxSnlp
private static final int maxSnlp- See Also:
-
kint32max
private static final int kint32max- See Also:
-
-
Constructor Details
-
CjkBreakEngine
- Throws:
IOException
-
-
Method Details
-
initializeJapanesePhraseParamater
private void initializeJapanesePhraseParamater() -
loadJapaneseExtensions
private void loadJapaneseExtensions() -
loadHiragana
private void loadHiragana() -
equals
-
hashCode
public int hashCode() -
getKatakanaCost
private static int getKatakanaCost(int wordlength) -
isKatakana
private static boolean isKatakana(int value) -
divideUpDictionaryRange
public int divideUpDictionaryRange(CharacterIterator inText, int startPos, int endPos, DictionaryBreakEngine.DequeI foundBreaks, boolean isPhraseBreaking) Description copied from class:DictionaryBreakEngine
Divide up a range of known dictionary characters handled by this break engine.
- Specified by:
divideUpDictionaryRange
in classDictionaryBreakEngine
- Parameters:
inText
- A UText representing the textstartPos
- The start of the range of dictionary charactersendPos
- The end of the range of dictionary charactersfoundBreaks
- Output of break positions. Positions are pushed. Pre-existing contents of the output stack are unaltered.- Returns:
- The number of breaks found
-
getPatternFromText
-