lexer

Documentation

Index

• type Lexer
  • func New(input string) *Lexer
  • func (l *Lexer) NextToken() token.Token

Types

type Lexer

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer is fed the program to be interpreted and reads over the characters one at a time returning tokens for each character

func New

func New(input string) *Lexer

New will create a Lexer to turn source code into tokens

func (*Lexer) NextToken

func (l *Lexer) NextToken() token.Token

NextToken will return the next token in the input