pe

Documentation

Index

• type SinusoidalPositionalEncoder
  • func NewSinusoidalPositionalEncoder(size, length int) *SinusoidalPositionalEncoder
  • func (r *SinusoidalPositionalEncoder) Encode(xs ...int) []mat.Matrix

Types

type SinusoidalPositionalEncoder

type SinusoidalPositionalEncoder struct {
	// Size is the encoding vector size.
	Size int
	// Length is the max number of positions.
	Length int
	// Vectors contains the pre-computed encoding.
	Vectors []mat.Matrix
}

SinusoidalPositionalEncoder uses the sine and cosine functions of different frequencies to compose position embeddings so to incorporate a notion of word order in non-recurrent models (Vaswani et al., 2017).

func NewSinusoidalPositionalEncoder

func NewSinusoidalPositionalEncoder(size, length int) *SinusoidalPositionalEncoder

NewSinusoidalPositionalEncoder returns a new SinusoidalPositionalEncoder ready to use.

func (*SinusoidalPositionalEncoder) Encode

func (r *SinusoidalPositionalEncoder) Encode(xs ...int) []mat.Matrix

Encode returns the positional encoding for the given positions.