parsing

package

v0.0.0-...-c51fe07 Latest Latest Go to latest Published: Nov 20, 2015 License: MPL-2.0 Imports: 3 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

This section is empty.

This section is empty.

This section is empty.

type Generator func() *Token

type StdScanner struct {
	// contains filtered or unexported fields
}

The standard scanner. It uses the "text/scanner" package.

func (s *StdScanner) FirstToken() *Token

Returns the first token. This method should only called once. The names of the token types are derived from the "text/scanner" package.

func (s *StdScanner) Init(kmap map[string]string, src io.Reader) *StdScanner

Initializes the Scanner.

kmap map[string]string: the keyword map. Initialize with SyntaxFile.ScanForKeyWords

src io.Reader: the source code.

type Token struct {
	// contains filtered or unexported fields
}

Represents a token resolved from a scanner.

func MakeToken(
	typ, distinct, text string,
	pos interface{}, nxt Generator) (t *Token)

func Retempty() *Token

func (tl *Token) Distinct() string

Returns the token text, if the token is a keyword or a distinct one-character-token.

func (tl *Token) Next() *Token

Returns the next token following to this.

func (tl *Token) Position() interface{}

Returns the token text position.

func (tl *Token) Text() string

Returns the token text.

func (tl *Token) Type() string

Returns the general token type, if the token is not a keyword and not a distinct one-character-token.