inferencewrapper

Documentation

Index

• func InitProviderSetHandlers(api huma.API, providerSetAPI *ProviderSetAPI)
• type ProviderSetAPI
  • func NewProviderSetAPI(ts *toolStore.ToolStore, mps *modelpresetStore.ModelPresetStore, ...) (*ProviderSetAPI, error)
  • func (ps *ProviderSetAPI) AddProvider(ctx context.Context, req *spec.AddProviderRequest) (*spec.AddProviderResponse, error)
  • func (ps *ProviderSetAPI) DeleteProvider(ctx context.Context, req *spec.DeleteProviderRequest) (*spec.DeleteProviderResponse, error)
  • func (ps *ProviderSetAPI) FetchCompletion(ctx context.Context, req *spec.CompletionRequest) (*spec.CompletionResponse, error)
  • func (ps *ProviderSetAPI) SetProviderAPIKey(ctx context.Context, req *spec.SetProviderAPIKeyRequest) (*spec.SetProviderAPIKeyResponse, error)
• type ProviderSetOption
  • func WithDebugConfig(debugConfig *debugclient.DebugConfig) ProviderSetOption
  • func WithLogger(logger *slog.Logger) ProviderSetOption
  • func WithSkillsRunScriptEnabled(enabled bool) ProviderSetOption

Functions

func InitProviderSetHandlers

func InitProviderSetHandlers(api huma.API, providerSetAPI *ProviderSetAPI)

Types

type ProviderSetAPI

type ProviderSetAPI struct {
	// contains filtered or unexported fields
}

ProviderSetAPI is a thin aggregator on top of inference-go's ProviderSetAPI. It owns:

• provider lifecycle (add/delete/set API key),
• attachment/tool hydration,
• mapping Conversation+CurrentTurn -> inference-go FetchCompletionRequest.

func NewProviderSetAPI

func NewProviderSetAPI(
	ts *toolStore.ToolStore,
	mps *modelpresetStore.ModelPresetStore,
	ss *skillStore.SkillStore,
	opts ...ProviderSetOption,
) (*ProviderSetAPI, error)

NewProviderSetAPI creates a new ProviderSetAPI wrapper.

• ts: tool store used to hydrate ToolChoices when needed.
• opts: functional options for configuring the wrapper (e.g. WithLogger, WithDebugConfig).

func (*ProviderSetAPI) AddProvider

func (ps *ProviderSetAPI) AddProvider(
	ctx context.Context,
	req *spec.AddProviderRequest,
) (*spec.AddProviderResponse, error)

AddProvider forwards to inference-go ProviderSetAPI.AddProvider.

func (*ProviderSetAPI) DeleteProvider

func (ps *ProviderSetAPI) DeleteProvider(
	ctx context.Context,
	req *spec.DeleteProviderRequest,
) (*spec.DeleteProviderResponse, error)

DeleteProvider forwards to inference-go ProviderSetAPI.DeleteProvider.

func (*ProviderSetAPI) FetchCompletion

func (ps *ProviderSetAPI) FetchCompletion(
	ctx context.Context,
	req *spec.CompletionRequest,
) (*spec.CompletionResponse, error)

FetchCompletion builds a normalized inference-go FetchCompletionRequest from app-level conversation types and calls inference-go's FetchCompletion.

func (*ProviderSetAPI) SetProviderAPIKey

func (ps *ProviderSetAPI) SetProviderAPIKey(
	ctx context.Context,
	req *spec.SetProviderAPIKeyRequest,
) (*spec.SetProviderAPIKeyResponse, error)

SetProviderAPIKey forwards to inference-go ProviderSetAPI.SetProviderAPIKey.

type ProviderSetOption

type ProviderSetOption func(*ProviderSetAPI)

func WithDebugConfig

func WithDebugConfig(debugConfig *debugclient.DebugConfig) ProviderSetOption

func WithLogger

func WithLogger(logger *slog.Logger) ProviderSetOption

func WithSkillsRunScriptEnabled

func WithSkillsRunScriptEnabled(enabled bool) ProviderSetOption

WithSkillsRunScriptEnabled controls whether skills.runscript is advertised to the model. Default: false (safer; matches the default fsskillprovider which disables scripts).