layernormsimple

Documentation

Overview

Package layernormsimple implements a simple version of LayerNorm (LayerNorm-simple).

Reference: "Understanding and Improving Layer Normalization" by Jingjing Xu, Xu Sun, Zhiyuan Zhang, Guangxiang Zhao, Junyang Lin (2019). (https://papers.nips.cc/paper/8689-understanding-and-improving-layer-normalization.pdf)

Index

• type Model
  • func New() *Model
  • func (m *Model) Forward(xs ...ag.Node) []ag.Node

Types

type Model

type Model struct {
	nn.BaseModel
}

Model is an empty model used to instantiate a new Processor.

func New

func New() *Model

New returns a new model.

func (*Model) Forward

func (m *Model) Forward(xs ...ag.Node) []ag.Node

Forward performs the forward step for each input node and returns the result.