Help us shape the future of Go! Take the 2026 Go Developer Survey

Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
- API
  
  Reference documentation for the pkg.go.dev API
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

latencykernel

package module

Go to main page

Versions in this module

v0

v0.3.0

Oct 20, 2026

Changes in this version

type Inputs

+ Routing *routing.Resolution

type Kernel

+ func (k *Kernel) CaptureTokens() int

+ func (k *Kernel) GraphModes() (decode, other string)

+ func (k *Kernel) PreSnapshotBytes() int64

+ func (k *Kernel) SequenceAdmissionBytes() int64

+ func (k *Kernel) SequenceBoundedBytes(inFlightTokens int) int64

+ func (k *Kernel) SequenceBoundedBytesAt(computedTokens, inFlightTokens int) int64

v0.2.0

Oct 14, 2026

Changes in this version

+ const EngineBehaviourCommit

type Kernel

+ func (k *Kernel) PDTransferDemand(tokens int, from, to kernel.Placement) kernel.TransferDemand

v0.1.0

Oct 9, 2026

Changes in this version

+ const EngineBehaviourVersion

+ const KernelAssumptionSet

+ func LoadBundle(path string) (*scenario.Scenario, *deployment.Deployment, error)

+ type Inputs struct

+ Chip *hardware.Chip

+ Coefficients []*coefficient.Set

+ Deployment *deployment.Deployment

+ Devices []*hardware.StorageDevice

+ Fabric *hardware.Fabric

+ Model *model.Graph

+ PoolIndex int

+ Rules resolve.EngineRules

+ Scenario *scenario.Scenario

+ func OpenInputs(scenario string, r Repos, poolIndex int) (Inputs, error)

+ type Kernel struct

+ func New(in Inputs) (*Kernel, error)

+ func Open(scenario string, r Repos) (*Kernel, error)

+ func OpenPool(scenario string, r Repos, poolIndex int) (*Kernel, error)

+ func (k *Kernel) AdmissionOverhead(promptTokens int) time.Duration

+ func (k *Kernel) CompletionOverhead() time.Duration

+ func (k *Kernel) DecodeContextParallelWidth() int

+ func (k *Kernel) Deployment() deployment.Pool

+ func (k *Kernel) Evidence() (measured, total int, assumed []string)

+ func (k *Kernel) FixedBytes() kernel.MemoryBreakdown

+ func (k *Kernel) OutputTokenOverhead() time.Duration

+ func (k *Kernel) PDTransferTime(tokens int, from, to kernel.Placement) time.Duration

+ func (k *Kernel) PrefillContextParallelWidth() int

+ func (k *Kernel) Provenance() []kernel.CoefficientOrigin

+ func (k *Kernel) Resolved() kernel.Resolution

+ func (k *Kernel) SequenceFixedBytes() int64

+ func (k *Kernel) SequenceVariableBytes(tokens int) int64

+ func (k *Kernel) StepTime(b kernel.Batch) kernel.StepEstimate

+ func (k *Kernel) StepTimeInto(b kernel.Batch, per map[kernel.Resource]time.Duration) kernel.StepEstimate

+ func (k *Kernel) TierTime(tier string, dir kernel.Direction, bytes int64, queueDepth int) time.Duration

+ type Repos struct

+ Catalog string

+ Registry string

+ Scenarios string