The highest tagged major version is
Documentation
¶
Overview ¶
Package stop implements a TokenFilter removing tokens found in a TokenMap.
It constructor takes the following arguments:
"stop_token_map" (string): the name of the token map identifying tokens to remove.
Index ¶
Constants ¶
View Source
const Name = "stop_tokens"
Variables ¶
This section is empty.
Functions ¶
Types ¶
type StopTokensFilter ¶
type StopTokensFilter struct {
// contains filtered or unexported fields
}
func NewStopTokensFilter ¶
func NewStopTokensFilter(stopTokens analysis.TokenMap) *StopTokensFilter
func (*StopTokensFilter) Filter ¶
func (f *StopTokensFilter) Filter(input analysis.TokenStream) analysis.TokenStream
Source Files
Click to show internal directories.
Click to hide internal directories.