Directories ¶
Path | Synopsis |
---|---|
Package generationutils implements a decoding search algorithm for conditional generation.
|
Package generationutils implements a decoding search algorithm for conditional generation. |
bart
Package bart implements the transformer model introduced by Mike et al., 2019.
|
Package bart implements the transformer model introduced by Mike et al., 2019. |
gen/proto/go/languagemodeling/v1
Package languagemodelingv1 is a reverse proxy.
|
Package languagemodelingv1 is a reverse proxy. |
gen/proto/go/questionanswering/v1
Package questionansweringv1 is a reverse proxy.
|
Package questionansweringv1 is a reverse proxy. |
gen/proto/go/textclassification/v1
Package textclassificationv1 is a reverse proxy.
|
Package textclassificationv1 is a reverse proxy. |
gen/proto/go/textencoding/v1
Package textencodingv1 is a reverse proxy.
|
Package textencodingv1 is a reverse proxy. |
gen/proto/go/textgeneration/v1
Package textgenerationv1 is a reverse proxy.
|
Package textgenerationv1 is a reverse proxy. |
gen/proto/go/tokenclassification/v1
Package tokenclassificationv1 is a reverse proxy.
|
Package tokenclassificationv1 is a reverse proxy. |
gen/proto/go/zeroshot/v1
Package zeroshotv1 is a reverse proxy.
|
Package zeroshotv1 is a reverse proxy. |
Package tokenizers is an interim solution while developing `gotokenizers` (https://github.com/nlpodyssey/gotokenizers).
|
Package tokenizers is an interim solution while developing `gotokenizers` (https://github.com/nlpodyssey/gotokenizers). |
basetokenizer
Package basetokenizer provides an implementations of a very simple tokenizer that splits by white-spaces (and alike) and punctuation symbols.
|
Package basetokenizer provides an implementations of a very simple tokenizer that splits by white-spaces (and alike) and punctuation symbols. |
sentencepiece/internal/sentencepiece
Package sentencepiece implements the SentencePiece encoder (Kudo and Richardson, 2018).
|
Package sentencepiece implements the SentencePiece encoder (Kudo and Richardson, 2018). |
utils
|
|
sliceutils
Package sliceutils provides types and functions for various operations over sliceutils of different types.
|
Package sliceutils provides types and functions for various operations over sliceutils of different types. |
Click to show internal directories.
Click to hide internal directories.