Versions in this module Expand all Collapse all v0 v0.1.1 Jan 11, 2022 Changes in this version + type FrenchTokenizer struct + func (t FrenchTokenizer) Tokenize(text string, mergeProperNouns bool) []string v0.1.0 Jan 7, 2022 Changes in this version + type Tokenizer struct + func (t Tokenizer) Tokenize(text string, mergeProperNouns bool) []string
Go to main page