token

package

v2.0.3+incompatible Latest Latest Go to latest Published: Nov 2, 2020 License: Apache-2.0, BSD-3-Clause Imports: 3 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

This section is empty.

View Source

var TokMap = TokenMap{
	// contains filtered or unexported fields
}

This section is empty.

type Pos struct {
	Offset int
	Line   int
	Column int
}

func (p Pos) String() string

type Token struct {
	Type
	Lit []byte
	Pos
}

func (t *Token) CharLiteralValue() string

CharLiteralValue returns the string value of the char literal.

func (t *Token) Float32Value() (float32, error)

Float32Value returns the float32 value of the token or an error if the token literal does not denote a valid float32.

func (t *Token) Float64Value() (float64, error)

Float64Value returns the float64 value of the token or an error if the token literal does not denote a valid float64.

func (t *Token) IDValue() string

IDValue returns the string representation of an identifier token.

func (t *Token) Int32Value() (int32, error)

Int32Value returns the int32 value of the token or an error if the token literal does not denote a valid float64.

func (t *Token) Int64Value() (int64, error)

Int64Value returns the int64 value of the token or an error if the token literal does not denote a valid float64.

func (t *Token) StringValue() string

StringValue returns the string value of the token literal.

func (t *Token) UTF8Rune() (rune, error)

UTF8Rune decodes the UTF8 rune in the token literal. It returns utf8.RuneError if the token literal contains an invalid rune.

type TokenMap struct {
	// contains filtered or unexported fields
}

func (m TokenMap) Id(tok Type) string

func (m TokenMap) StringType(typ Type) string

func (m TokenMap) TokenString(tok *Token) string

func (m TokenMap) Type(tok string) Type

type Type int

const (
	INVALID Type = iota
	EOF
)