milvus

README

Milvus

Using Milvus as the vector store.

Installation

For how to install Milvus in different scenarios, see Official Documents.

For testing purpose, here we choose to Install Milvus Standalone with Docker Compose.

$ wget https://github.com/milvus-io/milvus/releases/download/v2.2.4/milvus-standalone-docker-compose.yml -O docker-compose.yml
$ sudo docker compose up -d

Testing

$ go test -v -race
=== RUN   TestMilvus_Query
--- PASS: TestMilvus_Query (7.34s)
PASS
ok  	github.com/go-aie/gptbot/milvus	7.866s

Documentation

Index

• type Config
• type Milvus
  • func NewMilvus(cfg *Config) (*Milvus, error)
  • func (m *Milvus) Delete(ctx context.Context, documentIDs ...string) error
  • func (m *Milvus) Insert(ctx context.Context, chunks map[string][]*gptbot.Chunk) error
  • func (m *Milvus) LoadJSON(ctx context.Context, filename string) error
  • func (m *Milvus) Query(ctx context.Context, embedding gptbot.Embedding, corpusID string, topK int) ([]*gptbot.Similarity, error)

Types

type Config

type Config struct {
	// CollectionName is the collection name.
	// This field is required.
	CollectionName string

	// CreateNew specifies whether to overwrite if the collection already exists.
	CreateNew bool

	// Addr is the address of the Milvus server.
	// Defaults to "localhost:19530".
	Addr string

	// Dim is the embedding dimension.
	// Defaults to 1536 (the dimension generated by OpenAI's Embedding API).
	Dim int
}

type Milvus

type Milvus struct {
	// contains filtered or unexported fields
}

func NewMilvus

func NewMilvus(cfg *Config) (*Milvus, error)

func (*Milvus) Delete

func (m *Milvus) Delete(ctx context.Context, documentIDs ...string) error

Delete deletes the chunks belonging to the given documentIDs. As a special case, empty documentIDs means deleting all chunks.

func (*Milvus) Insert

func (m *Milvus) Insert(ctx context.Context, chunks map[string][]*gptbot.Chunk) error

func (*Milvus) LoadJSON

func (m *Milvus) LoadJSON(ctx context.Context, filename string) error

func (*Milvus) Query

func (m *Milvus) Query(ctx context.Context, embedding gptbot.Embedding, corpusID string, topK int) ([]*gptbot.Similarity, error)

Query searches similarities of the given embedding with default consistency level.