groups

Documentation

Overview

Package groups is routing groups: several models agents pick as one, each request sent to the right one and on to the next when one fails. While the user has a group, it stays on.

It serves the user's own groups on the gateway's router strategy point (P3 of docs/subsystems/plugin-runtime.md): Apply holds provider.ServeGroups, and off, the gateway neither lists nor routes them. The groups magpie finds (one model several providers serve) are the core's, on or off.