tokenizer

package
Version: v0.0.0-...-2443ee7 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 6, 2021 License: MIT Imports: 1 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type EnTokenizer

type EnTokenizer struct{}

EnTokenizer is English tokenizer

func (*EnTokenizer) Exec

func (e *EnTokenizer) Exec(s string) []string

Exec implements Tokenizer interface

type Tokenizer

type Tokenizer interface {
	Exec(string) []string
}

Tokenizer interface

Source Files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL