quantize

Documentation

Index

• func Model(m *zmf.Model, qt QuantType) error
• type QuantType

Functions

func Model

func Model(m *zmf.Model, qt QuantType) error

Model quantizes all FLOAT32 parameter tensors in the given ZMF model in-place.

Types

type QuantType

type QuantType string

QuantType selects the block quantization format.

const (
	Q4_0 QuantType = "q4_0"
	Q8_0 QuantType = "q8_0"
)