lexer

Documentation

Overview

Package lexer contains our simple lexer.

The lexer returns tokens from a (string) input, as a series of Token objects.

Index

• type Lexer
  • func New(input string) *Lexer
  • func (l *Lexer) GetLine() int
  • func (l *Lexer) NextToken() token.Token

Types

type Lexer

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer holds our object-state.

func New

func New(input string) *Lexer

New creates a Lexer instance from the given string

func (*Lexer) GetLine

func (l *Lexer) GetLine() int

GetLine returns the rough line-number of our current position.

This is used to report errors in a more humane manner.

func (*Lexer) NextToken

func (l *Lexer) NextToken() token.Token

NextToken reads and returns the next token, skipping any white space.