token

package

v0.15.0 Latest Latest Go to latest Published: Mar 15, 2024 License: BSD-3-Clause Imports: 4 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/gonum/gonum

Links

Open Source Insights

Documentation ¶

Overview ¶

Package token provides generated internal tokenizing functions for DOT parsing.

Constants ¶

This section is empty.

Variables ¶

View Source

var TokMap = TokenMap{
	// contains filtered or unexported fields
}

Functions ¶

This section is empty.

Types ¶

type Context ¶ added in v0.14.0

type Context interface{}

Context allows user-defined data to be associated with the lexer/scanner to be associated with each token that lexer produces.

type Pos ¶

type Pos struct {
	Offset  int
	Line    int
	Column  int
	Context Context
}

func (Pos) String ¶

func (p Pos) String() string

type Sourcer ¶ added in v0.14.0

type Sourcer interface {
	Source() string
}

Sourcer is a Context interface which presents a Source() method identifying e.g the filename for the current code.

type Token ¶

type Token struct {
	Type
	Lit []byte
	Pos
}

func (*Token) CharLiteralValue ¶ added in v0.14.0

func (t *Token) CharLiteralValue() string

CharLiteralValue returns the string value of the char literal.

func (*Token) Equals ¶ added in v0.14.0

func (t *Token) Equals(rhs interface{}) bool

Equals returns returns true if the token Type and Lit are matches.

func (*Token) Float32Value ¶ added in v0.14.0

func (t *Token) Float32Value() (float32, error)

Float32Value returns the float32 value of the token or an error if the token literal does not denote a valid float32.

func (*Token) Float64Value ¶ added in v0.14.0

func (t *Token) Float64Value() (float64, error)

Float64Value returns the float64 value of the token or an error if the token literal does not denote a valid float64.

func (*Token) IDValue ¶ added in v0.14.0

func (t *Token) IDValue() string

IDValue returns the string representation of an identifier token.

func (*Token) Int32Value ¶ added in v0.14.0

func (t *Token) Int32Value() (int32, error)

Int32Value returns the int32 value of the token or an error if the token literal does not denote a valid float64.

func (*Token) Int64Value ¶ added in v0.14.0

func (t *Token) Int64Value() (int64, error)

Int64Value returns the int64 value of the token or an error if the token literal does not denote a valid float64.

func (*Token) StringValue ¶ added in v0.14.0

func (t *Token) StringValue() string

StringValue returns the string value of the token literal.

func (*Token) UTF8Rune ¶ added in v0.14.0

func (t *Token) UTF8Rune() (rune, error)

UTF8Rune decodes the UTF8 rune in the token literal. It returns utf8.RuneError if the token literal contains an invalid rune.

type TokenMap ¶

type TokenMap struct {
	// contains filtered or unexported fields
}

func (TokenMap) Id ¶

func (m TokenMap) Id(tok Type) string

func (TokenMap) StringType ¶

func (m TokenMap) StringType(typ Type) string

func (TokenMap) TokenString ¶

func (m TokenMap) TokenString(tok *Token) string

func (TokenMap) Type ¶

func (m TokenMap) Type(tok string) Type

type Type ¶

type Type int

const (
	INVALID Type = iota
	EOF
)

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL