converter

Documentation

Index

• func ConvertSafetensorsToGGUF(inputDir, outputPath, arch string) error
• func ONNXToZMF(model *onnx.ModelProto) (*zmf.Model, error)
• func ONNXToZMFWithPath(model *onnx.ModelProto, modelPath string) (*zmf.Model, error)
• type SafetensorsDtype
• type SafetensorsFile
  • func OpenSafetensors(path string) (*SafetensorsFile, error)
  • func (sf *SafetensorsFile) Close() error
  • func (sf *SafetensorsFile) ReadTensorData(name string) ([]byte, error)
• type SafetensorsTensorInfo

Functions

func ConvertSafetensorsToGGUF

func ConvertSafetensorsToGGUF(inputDir, outputPath, arch string) error

ConvertSafetensorsToGGUF reads a HuggingFace model directory containing config.json and model.safetensors, maps tensor names and metadata using the existing GGUF mapping functions, and writes a GGUF file.

func ONNXToZMF

func ONNXToZMF(model *onnx.ModelProto) (*zmf.Model, error)

ONNXToZMF converts an ONNX model to the ZMF format.

func ONNXToZMFWithPath

func ONNXToZMFWithPath(model *onnx.ModelProto, modelPath string) (*zmf.Model, error)

ONNXToZMFWithPath converts an ONNX model to the ZMF format with support for external data files.

Types

type SafetensorsDtype

type SafetensorsDtype string

SafetensorsDtype represents a data type in the safetensors format.

const (
	DtypeF32  SafetensorsDtype = "F32"
	DtypeF16  SafetensorsDtype = "F16"
	DtypeBF16 SafetensorsDtype = "BF16"
)

type SafetensorsFile

type SafetensorsFile struct {
	Tensors    map[string]SafetensorsTensorInfo
	DataOffset int64 // byte offset where tensor data begins in the file
	// contains filtered or unexported fields
}

SafetensorsFile holds parsed safetensors header and a reader for tensor data.

func OpenSafetensors

func OpenSafetensors(path string) (*SafetensorsFile, error)

OpenSafetensors parses a safetensors file and returns its metadata. The caller must call Close() when done.

func (*SafetensorsFile) Close

func (sf *SafetensorsFile) Close() error

Close releases the underlying file.

func (*SafetensorsFile) ReadTensorData

func (sf *SafetensorsFile) ReadTensorData(name string) ([]byte, error)

ReadTensorData reads the raw bytes for the named tensor.

type SafetensorsTensorInfo

type SafetensorsTensorInfo struct {
	Dtype       SafetensorsDtype `json:"dtype"`
	Shape       []uint64         `json:"shape"`
	DataOffsets [2]uint64        `json:"data_offsets"`
}

SafetensorsTensorInfo describes a single tensor in the safetensors header.