monitoring

Documentation

Index

• type MetricsMonitor
  • func NewMetricsMonitor() *MetricsMonitor
  • func (m *MetricsMonitor) ObserveCompletionLatency(modelID string, latency time.Duration)
  • func (m *MetricsMonitor) UnregisterAllCollectors()
• type MetricsMonitoring

Types

type MetricsMonitor

type MetricsMonitor struct {
	// contains filtered or unexported fields
}

MetricsMonitor holds and updates Prometheus metrics.

func NewMetricsMonitor

func NewMetricsMonitor() *MetricsMonitor

NewMetricsMonitor returns a new MetricsMonitor.

func (*MetricsMonitor) ObserveCompletionLatency

func (m *MetricsMonitor) ObserveCompletionLatency(modelID string, latency time.Duration)

ObserveCompletionLatency observes a new latency data for a completion request.

func (*MetricsMonitor) UnregisterAllCollectors

func (m *MetricsMonitor) UnregisterAllCollectors()

UnregisterAllCollectors unregisters all connectors.

type MetricsMonitoring

type MetricsMonitoring interface {
	ObserveCompletionLatency(modelID string, latency time.Duration)
}

MetricsMonitoring is an interface for monitoring metrics.