bleve: github.com/blevesearch/bleve/analysis/tokenizer/unicode Index | Files

package unicode

import "github.com/blevesearch/bleve/analysis/tokenizer/unicode"

Index

Package Files

unicode.go

Constants

const Name = "unicode"

func UnicodeTokenizerConstructor Uses

func UnicodeTokenizerConstructor(config map[string]interface{}, cache *registry.Cache) (analysis.Tokenizer, error)

type UnicodeTokenizer Uses

type UnicodeTokenizer struct {
}

func NewUnicodeTokenizer Uses

func NewUnicodeTokenizer() *UnicodeTokenizer

func (*UnicodeTokenizer) Tokenize Uses

func (rt *UnicodeTokenizer) Tokenize(input []byte) analysis.TokenStream

Package unicode imports 3 packages (graph) and is imported by 48 packages. Updated 2016-10-02. Refresh now. Tools for package owners.