Versions in this module Expand all Collapse all v0 v0.1.0 Nov 10, 2024 Changes in this version + type Tokenizer struct + func New() *Tokenizer + func (t *Tokenizer) Tokenize(line string, lineNumber int) (tokens []token.Token, err error)
Go to main page