lexer

package

v0.0.0-...-5c28dc5 Latest Latest Go to latest Published: Feb 15, 2016 License: MIT Imports: 6 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

This section is empty.

This section is empty.

This section is empty.

type Lex struct {
	*scanner.Scanner
	Token rune
}

Lex is lexer for gigue. Lex provides token for scheme.

func New(r io.Reader) *Lex

New returns new lexer

func (l *Lex) IsTokenString() bool

IsTokenString check if token is string. It's use for get unquoted string in parser.

func (l *Lex) Next() (string, error)

Next returns next scheme token Parser calls this Next() iteratively for fetching token.

func (lex *Lex) Scan()

Scan makes scan

func (l *Lex) TokenAll() (tokens []string, err error)

TokenAll returns all token generated by lexer. It is useful for testing lexer.