llm

Documentation

Overview

Package llm provides LLM model creation and management.

Index

• type ModelFactory
  • func NewModelFactory(cfg *config.Config) *ModelFactory
  • func (mf *ModelFactory) Close() error
  • func (mf *ModelFactory) CreateModel(ctx context.Context) (model.LLM, error)
  • func (mf *ModelFactory) GetProviderInfo() string

Types

type ModelFactory

type ModelFactory struct {
	// contains filtered or unexported fields
}

ModelFactory creates LLM models based on configuration.

func NewModelFactory

func NewModelFactory(cfg *config.Config) *ModelFactory

NewModelFactory creates a new model factory.

func (*ModelFactory) Close

func (mf *ModelFactory) Close() error

Close cleans up resources (call when factory is no longer needed).

func (*ModelFactory) CreateModel

func (mf *ModelFactory) CreateModel(ctx context.Context) (model.LLM, error)

CreateModel creates an LLM model based on the configured provider.

func (*ModelFactory) GetProviderInfo

func (mf *ModelFactory) GetProviderInfo() string

GetProviderInfo returns information about the current provider.