proxybridge

Documentation

Index

• func MarshalChatRequest(req llm.ChatRequest) ([]byte, error)
• func MarshalResponsesRequest(req llm.ChatRequest) ([]byte, error)
• func ParseChatResponse(body []byte) (*llm.ChatResponse, error)
• func ParseSSEChunk(dataPayload string) (llm.StreamChunk, bool, error)
• type Bridge
  • func NewBridge(handler http.Handler) *Bridge
  • func (b *Bridge) Chat(ctx context.Context, req llm.ChatRequest) (*llm.ChatResponse, error)
  • func (b *Bridge) ChatStream(ctx context.Context, req llm.ChatRequest, callback llm.StreamCallback) error
  • func (b *Bridge) SetMetricsRecorder(recorder runtimeMetricsRecorder)
• type ProxyError
  • func (e *ProxyError) Error() string
  • func (e *ProxyError) IsClientError() bool
  • func (e *ProxyError) IsNoProvider() bool
  • func (e *ProxyError) IsOverloaded() bool

Functions

func MarshalChatRequest

func MarshalChatRequest(req llm.ChatRequest) ([]byte, error)

MarshalChatRequest converts llm.ChatRequest to OpenAI-format JSON bytes.

func MarshalResponsesRequest

func MarshalResponsesRequest(req llm.ChatRequest) ([]byte, error)

MarshalResponsesRequest converts llm.ChatRequest to native OpenAI Responses API JSON bytes.

func ParseChatResponse

func ParseChatResponse(body []byte) (*llm.ChatResponse, error)

ParseChatResponse parses OpenAI-format JSON into llm.ChatResponse.

func ParseSSEChunk

func ParseSSEChunk(dataPayload string) (llm.StreamChunk, bool, error)

ParseSSEChunk parses a single SSE data line into an llm.StreamChunk. Returns (chunk, done, error). done=true on [DONE] sentinel.

Types

type Bridge

type Bridge struct {
	// contains filtered or unexported fields
}

Bridge adapts llm.ChatRequest/ChatResponse to flow through an http.Handler proxy.

func NewBridge

func NewBridge(handler http.Handler) *Bridge

NewBridge creates a new bridge that routes LLM calls through the given handler.

func (*Bridge) Chat

func (b *Bridge) Chat(ctx context.Context, req llm.ChatRequest) (*llm.ChatResponse, error)

Chat sends a non-streaming request through the proxy pipeline.

func (*Bridge) ChatStream

func (b *Bridge) ChatStream(ctx context.Context, req llm.ChatRequest, callback llm.StreamCallback) error

ChatStream sends a streaming request through the proxy pipeline.

func (*Bridge) SetMetricsRecorder

func (b *Bridge) SetMetricsRecorder(recorder runtimeMetricsRecorder)

SetMetricsRecorder wires a lightweight counter recorder for normalization/runtime events.

type ProxyError

type ProxyError struct {
	StatusCode int
	Body       string // truncated error body for diagnostics
}

ProxyError wraps an HTTP status code from the proxy handler so callers can distinguish client errors (4xx, non-retryable) from server errors (5xx, retryable).

func (*ProxyError) Error

func (e *ProxyError) Error() string

func (*ProxyError) IsClientError

func (e *ProxyError) IsClientError() bool

IsClientError returns true for 4xx status codes (request is invalid, retrying won't help).

func (*ProxyError) IsNoProvider

func (e *ProxyError) IsNoProvider() bool

IsNoProvider returns true when no provider is available for the requested model. Retrying won't help — the user needs to configure/enable a provider.

func (*ProxyError) IsOverloaded

func (e *ProxyError) IsOverloaded() bool

IsOverloaded returns true for explicit overload statuses and common overload markers in proxy/upstream error bodies (e.g. wrapped upstream 5xx).