evaluators

Documentation

Overview

Package evaluators defines a set of Genkit Evaluators for popular use-cases

Index

• func ConfigureMetric(metric MetricConfig) ai.Evaluator
• type EvaluatorType
  • func (ss EvaluatorType) String() string
• type GenkitEval
  • func (ge *GenkitEval) Init(ctx context.Context) []core.Action
  • func (ge *GenkitEval) Name() string
• type MetricConfig

Functions

func ConfigureMetric

func ConfigureMetric(metric MetricConfig) ai.Evaluator

Types

type EvaluatorType

type EvaluatorType int

EvaluatorType is an enum used to indicate the type of evaluator being configured for use

const (
	EvaluatorDeepEqual EvaluatorType = iota
	EvaluatorRegex
	EvaluatorJsonata
)

func (EvaluatorType) String

func (ss EvaluatorType) String() string

type GenkitEval

type GenkitEval struct {
	Metrics []MetricConfig // Configs for individual metrics
	// contains filtered or unexported fields
}

GenkitEval is a Genkit plugin that provides evaluators

func (*GenkitEval) Init

func (ge *GenkitEval) Init(ctx context.Context) []core.Action

Init initializes the plugin.

func (*GenkitEval) Name

func (ge *GenkitEval) Name() string

type MetricConfig

type MetricConfig struct {
	MetricType EvaluatorType
}

MetricConfig provides configuration options for a specific metric. More Params (judge LLMs, etc.) could be configured by extending this struct