Documentation
¶
Index ¶
Constants ¶
View Source
const DictDirEnvName = "JIEBA_DICT_DIR"
View Source
const FilterName = "filter_jieba"
Variables ¶
This section is empty.
Functions ¶
func JiebaFilterConstructor ¶
Types ¶
type JiebaFilter ¶
type JiebaFilter struct {
// contains filtered or unexported fields
}
JiebaFilter implements word segmentation for Chinese. It's a filter so that is can used with other tokenizer (e.g. unicode).
func NewJiebaFilter ¶
func NewJiebaFilter(dictDir string, searchMode, useHMM bool) *JiebaFilter
func (*JiebaFilter) Filter ¶
func (f *JiebaFilter) Filter(input analysis.TokenStream) analysis.TokenStream
func (*JiebaFilter) JiebaInstance ¶
func (f *JiebaFilter) JiebaInstance() *JiebaInstance
JiebaInstance returns the underly JiebaInstance.
type JiebaInstance ¶
type JiebaInstance struct {
// contains filtered or unexported fields
}
JiebaInstance is a thread-safe *jieba.Jieba for a given dict directory.
func FindAllJiebaInstances ¶
func FindAllJiebaInstances() []*JiebaInstance
FindAllJiebaInstances returns all exists JiebaInstances.
func FindJiebaInstance ¶
func FindJiebaInstance(dictDir string) *JiebaInstance
FindJiebaInstance returns an exists JiebaInstance for a given dict directory or nil if not found.
func NewJiebaInstance ¶
func NewJiebaInstance(dictDir string) *JiebaInstance
NewJiebaInstance creates a new JiebaInstance or returns an exists JiebaInstance for a given dict directory.
func (*JiebaInstance) DictDir ¶
func (inst *JiebaInstance) DictDir() string
DictDir returns the dict directory.
func (*JiebaInstance) Get ¶
func (inst *JiebaInstance) Get() (*jieba.Jieba, func())
Get returns *jieba.Jieba and a defer function which MUST be called after using.
Source Files
Click to show internal directories.
Click to hide internal directories.