provider

Documentation

Overview

Package provider defines the LLM and embedding interfaces mneme depends on, plus implementations (an OpenAI-compatible HTTP client in provider/openai and deterministic fakes in provider/fake).

Index

• type Embedder
• type LLM

Types

type Embedder

type Embedder interface {
	Embed(ctx context.Context, texts []string) ([][]float32, error)
	Dim() int
}

Embedder turns text into vectors. Embed is batch: it accepts many texts and returns one vector per input, in order.

type LLM

type LLM interface {
	// Complete returns the assistant text for the given system+user prompt.
	// When jsonObject is true the provider requests a JSON object response
	// (response_format) so the model is steered toward valid JSON; callers
	// must still parse defensively.
	Complete(ctx context.Context, system, user string, jsonObject bool) (string, error)
}

LLM is the text-completion surface the extraction pipeline needs.