contextbudget

Documentation

Overview

Package contextbudget trims oversized input before it reaches the local model, keeping requests inside the model's context window.

Index

• func IsTrivial(input string) bool
• func Trim(input string, maxChars int) (string, bool)

Functions

func IsTrivial

func IsTrivial(input string) bool

IsTrivial reports whether input is too small/empty to bother offloading.

func Trim

func Trim(input string, maxChars int) (string, bool)

Trim caps input to maxChars. When it must cut, it keeps the head and tail (where summaries/structure usually live) and inserts an elision marker. Both cut points back off to a rune boundary (LO-13: byte-offset cuts split multibyte runes — Spanish á/ñ at a boundary produced mojibake mid-prompt). Returns the possibly-trimmed text and whether trimming occurred.