llm

Documentation

Index

• func WithAPIKey(apiKey string) opt
• func WithBaseURL(baseURL string) opt
• func WithModel(model string) opt
• func WithProvider(provider string) opt
• type ChatRequest
• type LLM
  • func NewLLM(opts ...opt) (LLM, error)
• type Message
• type Role

Functions

func WithAPIKey

func WithAPIKey(apiKey string) opt

func WithBaseURL

func WithBaseURL(baseURL string) opt

func WithModel

func WithModel(model string) opt

func WithProvider

func WithProvider(provider string) opt

Types

type ChatRequest

type ChatRequest struct {
	SystemPrompt string
	Prompt       Message
	Transcript   []Message
}

ChatRequest captures a normalized chat request for LLM providers.

type LLM

type LLM interface {
	Complete(ctx context.Context, req ChatRequest) (Message, error)
}

LLM defines the interface for language model providers. It abstracts away provider-specific details and allows for interchangeable implementations.

func NewLLM

func NewLLM(opts ...opt) (LLM, error)

NewLLM builds an LLM based on the supplied configuration.

type Message

type Message struct {
	Role      Role
	Content   string
	Timestamp time.Time
}

Message is a transcript entry exchanged within a session.

type Role

type Role string

Role represents the speaker of a message.

const (
	RoleUser      Role = "user"
	RoleAssistant Role = "assistant"
	RoleSystem    Role = "system"
)