llm

Documentation

Index

• type Option
  • func WithJSONMode() Option
  • func WithMaxTokens(n int) Option
  • func WithTemperature(t float64) Option
• type Provider
  • func NewProvider(cfg *config.LLMConfig) (Provider, error)

Types

type Option

type Option func(*callOptions)

Option configures LLM completion.

func WithJSONMode

func WithJSONMode() Option

func WithMaxTokens

func WithMaxTokens(n int) Option

func WithTemperature

func WithTemperature(t float64) Option

type Provider

type Provider interface {
	Complete(ctx context.Context, prompt string, opts ...Option) (string, error)
	Embed(ctx context.Context, text string) ([]float32, error)
	EmbedBatch(ctx context.Context, texts []string) ([][]float32, error)
	Name() string
	ModelID() string
}

Provider is the unified LLM interface.

func NewProvider

func NewProvider(cfg *config.LLMConfig) (Provider, error)

NewProvider constructs the configured provider.