command
Version:
v0.2.2
Opens a new window with list of versions in this module.
Published: Jun 25, 2023
License: Apache-2.0
Opens a new window with license information.
Imports: 13
Opens a new window with list of imports.
Imported by: 0
Opens a new window with list of known importers.
README
¶
Basic examples
This demonstrates how to use different models (i.e., BERT or BPE) in a
tokenizer.
To run:
go run . -model=bert
go run . -model=bpe
Documentation
¶
There is no documentation for this package.
Source Files
¶
Click to show internal directories.
Click to hide internal directories.