localinference

Documentation

Index

• func FromLocalModel(lm *model.LocalModel, modelDir string) api.LocalInferenceSupport
• func FromMarketplace(format, architecture, className string) api.LocalInferenceSupport
• func FromMarketplaceModel(format, architecture, className, modelName, pipelineTag string) api.LocalInferenceSupport

Functions

func FromLocalModel

func FromLocalModel(lm *model.LocalModel, modelDir string) api.LocalInferenceSupport

FromLocalModel reports whether a downloaded model can run locally via llama.cpp or the Diffusers image runtime.

func FromMarketplace

func FromMarketplace(format, architecture, className string) api.LocalInferenceSupport

FromMarketplace reports whether a marketplace model is likely to support local inference after download, based on format tags and hub metadata.

func FromMarketplaceModel

func FromMarketplaceModel(format, architecture, className, modelName, pipelineTag string) api.LocalInferenceSupport

FromMarketplaceModel reports likely support for a marketplace model when the model id/name or task tag provides stronger routing hints than config metadata.