lexer

package

v0.0.0-...-0effba1 Latest Latest Go to latest Published: Jan 20, 2023 License: BSD-3-Clause Imports: 5 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Package lexer includes functionality for scanning a Plan source file into a sequence of tokens.

This section is empty.

This section is empty.

func Scan(source []byte) <-chan Lexeme

Scan scans the given Plan source, producing a sequence of lexical tokens.

Once the end of the file is reached, or an error is encountered, the channel will be closed, resulting in an endless sequence of EndOfFile tokens.

type Lexeme struct {
	Token    token.Token
	Position token.Position
	Value    string
}

Lexeme describes a token, its position, and its textual value.

func (l Lexeme) String() string