Documentation ¶
Index ¶
- type Tokenizer
- func (t *Tokenizer) CurrentToken() *compast.Token
- func (t *Tokenizer) GetNextTokenInLine() *compast.Token
- func (t *Tokenizer) MaybeGetArgsAndHelpToken() (args []*compast.Token)
- func (t *Tokenizer) MaybeGetHelpToken() *compast.Token
- func (t *Tokenizer) MaybeGetLabel() *compast.Token
- func (t *Tokenizer) MaybeGetLiteralAndLabel() (literal *compast.Token, label *compast.Token)
- func (t *Tokenizer) MustGetNextTokenInLine(expectedType int, error string) *compast.Token
- func (t *Tokenizer) MustHaveNoTokenInLine()
- func (t *Tokenizer) NextToken() *compast.Token
- func (t *Tokenizer) PushBack(tok *compast.Token)
- func (t *Tokenizer) SourceLocation() (string, int, int)
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Tokenizer ¶
type Tokenizer struct {
// contains filtered or unexported fields
}
func NewTokenizer ¶
func NewTokenizer(source string, d *compromise.Directives) *Tokenizer
NewTokenizer creates a new Tokenizer that tokenizes a completion spec string.
func (*Tokenizer) CurrentToken ¶
func (*Tokenizer) GetNextTokenInLine ¶
func (*Tokenizer) MaybeGetArgsAndHelpToken ¶
func (*Tokenizer) MaybeGetHelpToken ¶
func (*Tokenizer) MaybeGetLabel ¶
func (*Tokenizer) MaybeGetLiteralAndLabel ¶
func (*Tokenizer) MustGetNextTokenInLine ¶
func (*Tokenizer) MustHaveNoTokenInLine ¶
func (t *Tokenizer) MustHaveNoTokenInLine()
Click to show internal directories.
Click to hide internal directories.