cache

Documentation

Index

• type InMemorySemanticCache
  • func NewInMemorySemanticCache() *InMemorySemanticCache
  • func (c *InMemorySemanticCache) Get(ctx context.Context, queryEmbedding []float32, threshold float32) (string, bool, error)
  • func (c *InMemorySemanticCache) Set(ctx context.Context, queryEmbedding []float32, response string) error

Types

type InMemorySemanticCache

type InMemorySemanticCache struct {
	// contains filtered or unexported fields
}

InMemorySemanticCache is a lightweight, concurrent-safe semantic cache. For production, this could be backed by Redis + Vector Search (like RedisVL).

func NewInMemorySemanticCache

func NewInMemorySemanticCache() *InMemorySemanticCache

func (*InMemorySemanticCache) Get

func (c *InMemorySemanticCache) Get(ctx context.Context, queryEmbedding []float32, threshold float32) (string, bool, error)

func (*InMemorySemanticCache) Set

func (c *InMemorySemanticCache) Set(ctx context.Context, queryEmbedding []float32, response string) error