lexer

package

v0.0.0-...-c85daa3 Latest Latest Go to latest Published: Feb 19, 2021 License: MIT Imports: 6 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

This section is empty.

This section is empty.

func DetermineStringType(str string) string

DetermineStringType will determine the type of a given string

func GetPrec(operator string) int

GetPrec is a simple wrapper for GetOperatorAttributes but only returns the precedance

func IsLitteral(token Token) bool

IsLitteral checks if a given token is a litteral type

func ThrowSemanticError(token *Token, expected []string, filename string)

ThrowSemanticError can be used when an error occurs while generating an AST and not at interpret time

type Lexer struct {
	Tokens []Token

	FileName, Program string
	// contains filtered or unexported fields
}

Lexer contains all the info needed for the lexer to generate a set of usable tokens

func NewLexer(filename string, program string) *Lexer

NewLexer creates a new instance of a lexer stuct

func (l *Lexer) Lex()

Lex takes a sourcecode string and transforms it into usable tokens to build an AST with

type OperatorAttributes struct {
	Precedance    int
	Associativity string
}

OperatorAttributes wraps the precedance and Associativity of a operator

func GetOperatorAttributes(operator string) OperatorAttributes

GetOperatorAttributes returns the precedance and associativity of an operator

type Token struct {
	Value, Type string
	Line, Col   int
}

Token contains all info about a specific token from syntax

func (lhs Token) HasHigherPrec(rhs Token) bool

HasHigherPrec is a simple check for checking if lhs has a bigger precednce than rhs