Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
- API
  
  Reference documentation for the pkg.go.dev API
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

llm

package module

Go to main page

Versions in this module

v0

v0.3.0

Sep 13, 2026

v0.2.0

Sep 11, 2026

Changes in this version

+ const MetaAborted

+ const MetaCachedTokens

+ const MetaChunks

+ const MetaCostUSD

+ const MetaEnergyJ

+ const MetaGoodput

+ const MetaITLMaxMs

+ const MetaITLMeanMs

+ const MetaITLP50Ms

+ const MetaITLSamples

+ const MetaResponseHeadersMs

+ const MetaTPOTMs

+ const MetaTTFTMs

+ const MetaTTFTextMs

+ const MetaThinkingChunks

+ const MetaThinkingTokens

+ const SyntheticProducerTagKey

+ const SyntheticTagKey

+ type Agento11yConfig struct

+ AgentName string

+ AgentVersion string

+ AuthMode string

+ BasicPassword string

+ BasicUser string

+ BearerToken string

+ CaptureContent bool

+ Endpoint string

+ FlushInterval time.Duration

+ Insecure *bool

+ Protocol string

+ Synthetic bool

+ Tags map[string]string

+ TenantID string

type Client

+ func (c *Client) Embed(req map[string]any) *sobek.Promise

+ func (c *Client) Flush() error

type Options

+ Agento11y *Agento11yConfig

+ Wire Wire

+ type Session struct

+ func (s *Session) Id() string

+ func (s *Session) Messages() []map[string]any

+ func (s *Session) Reset()

+ func (s *Session) Send(arg sobek.Value) *sobek.Promise

+ func (s *Session) Tokens() map[string]any

+ func (s *Session) Turn() int

+ type ToolCall struct

+ Arguments string

+ ID string

+ Name string

+ type Wire string

+ const WireAnthropic

+ const WireOpenAI

+ const WireResponses

v0.1.0

May 15, 2026

Changes in this version

+ type Client struct

+ func (c *Client) Chat(req map[string]any) *sobek.Promise

+ type CostModel struct

+ USDPerMInputTokens float64

+ USDPerMOutputTokens float64

+ func (c *CostModel) Empty() bool

+ func (c *CostModel) USD(promptTokens, completionTokens int) float64

+ type Dataset struct

+ func (d *Dataset) At(i int64) map[string]any

+ func (d *Dataset) Next() map[string]any

+ func (d *Dataset) Reset()

+ func (d *Dataset) Size() int

+ type EnergyModel struct

+ IdleW float64

+ JPerInputToken float64

+ JPerOutputToken float64

+ func (e *EnergyModel) Empty() bool

+ func (e *EnergyModel) Joules(promptTokens, completionTokens int, duration time.Duration) float64

+ type Options struct

+ APIKey string

+ BaseURL string

+ Cost *CostModel

+ DefaultSLO *SLOPredicate

+ Energy *EnergyModel

+ Headers map[string]string

+ IgnoreEOS bool

+ Model string

+ Timeout time.Duration

+ type SLOPredicate struct

+ E2ELMs float64

+ TPOTMs float64

+ TTFTMs float64

+ func (s *SLOPredicate) Empty() bool