README ΒΆ

release Go Reference Codacy Badge Go Report Card DepShield Badge FOSSA Status DeepSource CLA Artifact Hub Slack Twitter

What is Vald?

Vald is a highly scalable distributed fast approximate nearest neighbor dense vector search engine.

Vald is designed and implemented based on Cloud-Native architecture.

It uses the fastest ANN Algorithm NGT to search neighbors.

Vald has automatic vector indexing and index backup, and horizontal scaling which made for searching from billions of feature vector data.

Vald is easy to use, feature-rich and highly customizable as you needed.

Go to Get Started page to try out Vald :)

(If you are interested in ANN benchmarks, please refer to the official website.)

Main Features

  • Asynchronous Auto Indexing

    • Usually the graph requires locking during indexing, which causes stop-the-world. But Vald uses distributed index graphs so it continues to work during indexing.
  • Customizable Ingress/Egress Filtering

    • Vald implements it's own highly customizable Ingress/Egress filter.
    • Which can be configured to fit the gRPC interface.
      • Ingress Filter: Ability to Vectorize through filter on request.
      • Egress Filter: rerank or filter the searching result with your own algorithm.
  • Cloud-native based vector searching engine

    • Horizontal scalable on memory and CPU for your demand.
  • Auto Backup for Index data

    • Vald has a feature to store the backup of the index data using MySQL or Cassandra which enables disaster recovery.
  • Distributed Indexing

    • Vald distribute vector index to multiple agents, each agent stores different index.
  • Index Replication

    • Vald stores each index in multiple agents which enables index replicas.
    • Automatically rebalance the replica when some Vald agent goes down.
  • Easy to use

    • Vald can be easily installed in a few steps.
  • Highly customizable

    • You can configure the number of vector dimensions, the number of replica and etc.
  • Multi language supported

    • Go, Java, Clojure, Node.js, and Python client library are supported.
    • gRPC APIs can be triggered by any programming languages which support gRPC.
    • REST API is also supported.

Requirements

  • Kubernetes 1.17~
  • AVX2 instructions (required by Vald Agent NGT)

Get Started

Please refer to Get Started.

Installation

Using Helm

helm repo add vald https://vald.vdaas.org/charts
helm install vald-cluster vald/vald

If you use the default values.yaml, the nightly images will be installed.

Docker image tagging policy
  • nightly ... latest build of master branch
  • vX.X.X ... released versions
  • latest ... latest build of release versions
  • stable ... latest long-term supported version

Using Helm-operator

vald-helm-operator

Example

Write example here

Architecture Overview

Please refer here for more details of the architecture overview in the future.

Development

Before your first commit to this repository, it is strongly recommended to run the commands below.

make init

Components

Component Docker image
Agent NGT
Agent Sidecar
Discoverer
Gateways






Backup Managers


Compressor
Metas


Index Manager
Helm Operator

Contribution

Please read the contribution guide

Contributors

All Contributors

Thanks goes to these wonderful people (emoji key):


Yusuke Kato

πŸ’» 🎨 🚧 πŸ“†

Rintaro Okamura

πŸ’» πŸ“– 🚧 πŸ“¦

Kosuke Morimoto

πŸ’» πŸ’‘ πŸ”§ ⚠️

Kiichiro YUKAWA

πŸ“– 🚧 ⚠️ βœ…

datelier

πŸ’» πŸ€”

Kevin Diu

πŸ“– πŸ’‘ ⚠️ βœ…

Hiroto Funakoshi

πŸ“– πŸ”§ ⚠️ βœ…

taisho

🎨 πŸ“– πŸ’‘

Pierre Grimaud

πŸ“–

Omer Katz

πŸ“– βœ…

LICENSE

vald released under Apache 2.0 license, refer LICENSE file.

FOSSA Status

Directories ΒΆ

Path Synopsis
apis module
grpc/v1/vald
Package vald provides vald server interface
Package vald provides vald server interface
cmd
agent/core/ngt
Package main provides program main
Package main provides program main
agent/sidecar
Package main provides program main
Package main provides program main
discoverer/k8s
Package main provides program main
Package main provides program main
filter/ingress/tensorflow
Package main provides program main
Package main provides program main
gateway/backup
Package main provides program main
Package main provides program main
gateway/filter
Package main provides program main
Package main provides program main
gateway/lb
Package main provides program main
Package main provides program main
gateway/meta
Package main provides program main
Package main provides program main
gateway/vald
Package main provides program main
Package main provides program main
manager/backup/cassandra
Package main provides program main
Package main provides program main
manager/backup/mysql
Package main provides program main
Package main provides program main
manager/compressor
Package main provides program main
Package main provides program main
manager/index
Package main provides program main
Package main provides program main
manager/replication/agent
Package main provides program main
Package main provides program main
manager/replication/controller
Package main provides program main
Package main provides program main
meta/cassandra
Package main provides program main
Package main provides program main
meta/redis
Package main provides program main
Package main provides program main
example
client Module
hack
benchmark/core/benchmark
Package benchmark provides benchmark frame Package benchmark provides benchmark frame Package benchmark provides benchmark frame
Package benchmark provides benchmark frame Package benchmark provides benchmark frame Package benchmark provides benchmark frame
benchmark/core/benchmark/strategy
Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy
Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy
pkg
agent/core/ngt/config
Package setting stores all server application settings
Package setting stores all server application settings
agent/core/ngt/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
agent/core/ngt/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
agent/core/ngt/model
Package model defines object structure
Package model defines object structure
agent/core/ngt/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
agent/core/ngt/service
Package service manages the main logic of server.
Package service manages the main logic of server.
agent/core/ngt/service/vqueue
Package vqueue manages the vector cache layer for reducing FFI overhead for fast Agent processing.
Package vqueue manages the vector cache layer for reducing FFI overhead for fast Agent processing.
agent/sidecar/config
Package setting stores all server application settings
Package setting stores all server application settings
agent/sidecar/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
agent/sidecar/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
agent/sidecar/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
agent/sidecar/service
Package service manages the main logic of server.
Package service manages the main logic of server.
agent/sidecar/service/observer
Package observer provides storage observer Package observer provides storage observer Package observer provides storage observer
Package observer provides storage observer Package observer provides storage observer Package observer provides storage observer
agent/sidecar/service/restorer
Package restorer provides restorer service Package restorer provides restorer service
Package restorer provides restorer service Package restorer provides restorer service
agent/sidecar/service/storage
Package storage provides blob storage service Package storage provides blob storage service Package storage provides blob storage service
Package storage provides blob storage service Package storage provides blob storage service Package storage provides blob storage service
discoverer/k8s/config
Package setting stores all server application settings
Package setting stores all server application settings
discoverer/k8s/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
discoverer/k8s/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
discoverer/k8s/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
discoverer/k8s/service
Package service manages the main logic of server.
Package service manages the main logic of server.
filter/ingress/tensorflow/config
Package setting stores all server application settings
Package setting stores all server application settings
filter/ingress/tensorflow/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
filter/ingress/tensorflow/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
filter/ingress/tensorflow/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
gateway/backup/config
Package setting stores all server application settings
Package setting stores all server application settings
gateway/backup/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
gateway/backup/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
gateway/backup/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
gateway/filter/config
Package setting stores all server application settings
Package setting stores all server application settings
gateway/filter/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
gateway/filter/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
gateway/filter/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
gateway/lb/config
Package setting stores all server application settings
Package setting stores all server application settings
gateway/lb/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
gateway/lb/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
gateway/lb/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
gateway/lb/service
Package service manages the main logic of server.
Package service manages the main logic of server.
gateway/lb/usecase
Package usecase represents gateways usecase layer
Package usecase represents gateways usecase layer
gateway/meta/config
Package setting stores all server application settings
Package setting stores all server application settings
gateway/meta/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
gateway/meta/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
gateway/meta/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
gateway/meta/service
Package service manages the main logic of server.
Package service manages the main logic of server.
gateway/vald/config
Package setting stores all server application settings
Package setting stores all server application settings
gateway/vald/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
gateway/vald/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
gateway/vald/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
gateway/vald/service
Package service Package service manages the main logic of server.
Package service Package service manages the main logic of server.
manager/backup/cassandra/config
Package setting stores all server application settings
Package setting stores all server application settings
manager/backup/cassandra/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
manager/backup/cassandra/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
manager/backup/cassandra/model
Package grpc provides grpc server logic
Package grpc provides grpc server logic
manager/backup/cassandra/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
manager/backup/cassandra/service
Package service manages the main logic of server.
Package service manages the main logic of server.
manager/backup/mysql/config
Package setting stores all server application settings
Package setting stores all server application settings
manager/backup/mysql/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
manager/backup/mysql/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
manager/backup/mysql/model
Package grpc provides grpc server logic
Package grpc provides grpc server logic
manager/backup/mysql/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
manager/backup/mysql/service
Package service manages the main logic of server.
Package service manages the main logic of server.
manager/compressor/config
Package setting stores all server application settings
Package setting stores all server application settings
manager/compressor/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
manager/compressor/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
manager/compressor/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
manager/compressor/service
Package service Package service Package service manages the main logic of server.
Package service Package service Package service manages the main logic of server.
manager/index/config
Package setting stores all server application settings
Package setting stores all server application settings
manager/index/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
manager/index/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
manager/index/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
manager/index/service
Package service manages the main logic of server.
Package service manages the main logic of server.
manager/replication/agent/config
Package setting stores all server application settings
Package setting stores all server application settings
manager/replication/agent/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
manager/replication/agent/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
manager/replication/agent/model
Package grpc provides grpc server logic
Package grpc provides grpc server logic
manager/replication/agent/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
manager/replication/agent/service
Package service manages the main logic of server.
Package service manages the main logic of server.
manager/replication/controller/config
Package setting stores all server application settings
Package setting stores all server application settings
manager/replication/controller/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
manager/replication/controller/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
manager/replication/controller/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
manager/replication/controller/service
Package service manages the main logic of server.
Package service manages the main logic of server.
meta/cassandra/config
Package setting stores all server application settings
Package setting stores all server application settings
meta/cassandra/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
meta/cassandra/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
meta/cassandra/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
meta/cassandra/service
Package service manages the main logic of server.
Package service manages the main logic of server.
meta/redis/config
Package setting stores all server application settings
Package setting stores all server application settings
meta/redis/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
Package grpc provides grpc server logic Package grpc provides grpc server logic
meta/redis/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
Package rest provides rest api logic Package rest provides rest api logic
meta/redis/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
meta/redis/service
Package service manages the main logic of server.
Package service manages the main logic of server.
tools/cli/loadtest/config
Package setting stores all server application settings
Package setting stores all server application settings
internal
backoff
Package backoff provides backoff function controller Package backoff provides backoff function controller
Package backoff provides backoff function controller Package backoff provides backoff function controller
cache
Package cache provides implementation of cache Package cache provides implementation of cache
Package cache provides implementation of cache Package cache provides implementation of cache
cache/cacher
Package cacher provides implementation of cache type definition
Package cacher provides implementation of cache type definition
cache/gache
Package gache provides implementation of cache using gache Package gache provides implementation of cache using gache
Package gache provides implementation of cache using gache Package gache provides implementation of cache using gache
client/v1/client
Package client provides vald component client interfaces
Package client provides vald component client interfaces
client/v1/client/agent/core
Package core provides agent ngt gRPC client functions Package core provides agent ngt gRPC client functions
Package core provides agent ngt gRPC client functions Package core provides agent ngt gRPC client functions
client/v1/client/compressor
Package compressor represents compressor client Package compressor represents compressor client
Package compressor represents compressor client Package compressor represents compressor client
client/v1/client/discoverer
Package discoverer Package discoverer
Package discoverer Package discoverer
client/v1/client/filter/egress
Package egress provides egress filter client logic Package egress provides egress filter client logic
Package egress provides egress filter client logic Package egress provides egress filter client logic
client/v1/client/filter/ingress
Package ingress provides ingress filter client logic Package ingress provides ingress filter client logic
Package ingress provides ingress filter client logic Package ingress provides ingress filter client logic
client/v1/client/vald
Package vald provides vald grpc client library Package vald provides vald grpc client library
Package vald provides vald grpc client library Package vald provides vald grpc client library
compress
Package compress provides compressor interface Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package compress provides compressor interface Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
config
Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic
Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic
core/algorithm
Package algorithm defines vald's core ann algorithm interface & constraint.
Package algorithm defines vald's core ann algorithm interface & constraint.
core/algorithm/ngt
Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT
Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT
core/converter/tensorflow
Package tensorflow provides implementation of Go API for extract data to vector Package tensorflow provides implementation of Go API for extract data to vector Package tensorflow provides implementation of Go API for extract data to vector
Package tensorflow provides implementation of Go API for extract data to vector Package tensorflow provides implementation of Go API for extract data to vector Package tensorflow provides implementation of Go API for extract data to vector
db/kvs/redis
Package redis provides implementation of Go API for redis interface Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package redis provides implementation of Go API for redis interface Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
db/rdb/mysql
Package mysql provides the functions for handling vald's data with MySQL.
Package mysql provides the functions for handling vald's data with MySQL.
db/rdb/mysql/dbr
Package dbr provides the dbr functions for handling with databases.
Package dbr provides the dbr functions for handling with databases.
db/storage/blob/s3/reader
Package reader provides the reader functions for handling with s3.
Package reader provides the reader functions for handling with s3.
errgroup
Package errgroup provides server global wait group for graceful kill all goroutine
Package errgroup provides server global wait group for graceful kill all goroutine
errors
Package errors provides error types and function Package errors provides benchmark error Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides benchmark error Package errors provides error types and function Package errors provides error types and function Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package errors provides error types and function Package errors provides benchmark error Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides benchmark error Package errors provides error types and function Package errors provides error types and function Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
file
Package file provides file I/O functionality
Package file provides file I/O functionality
info
Package info provides build-time info Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package info provides build-time info Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
io
Package io provides io functions Package io provides io functions
Package io provides io functions Package io provides io functions
io/ioutil
Package ioutil provides utility function for I/O
Package ioutil provides utility function for I/O
k8s
Package k8s provides kubernetes control functionality Package k8s provides kubernetes control functionality
Package k8s provides kubernetes control functionality Package k8s provides kubernetes control functionality
k8s/metrics/node
Package node provides kubernetes node information and preriodically update Package node provides kubernetes node information and preriodically update
Package node provides kubernetes node information and preriodically update Package node provides kubernetes node information and preriodically update
k8s/metrics/pod
Package pod provides kubernetes pod information and preriodically update Package pod provides kubernetes pod information and preriodically update
Package pod provides kubernetes pod information and preriodically update Package pod provides kubernetes pod information and preriodically update
k8s/node
Package node provides kubernetes node information and preriodically update Package node provides kubernetes node information and preriodically update
Package node provides kubernetes node information and preriodically update Package node provides kubernetes node information and preriodically update
k8s/pod
Package pod provides kubernetes pod information and preriodically update Package pod provides kubernetes pod information and preriodically update
Package pod provides kubernetes pod information and preriodically update Package pod provides kubernetes pod information and preriodically update
log
net
Package net provides net functionality for vald's network connection Package net provides net functionality for vald's network connection Package tcp provides tcp option
Package net provides net functionality for vald's network connection Package net provides net functionality for vald's network connection Package tcp provides tcp option
net/control
Package control provides network socket option Package control provides network socket option
Package control provides network socket option Package control provides network socket option
net/grpc
Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc
Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc
net/grpc/codes
Package codes provides status codes of grpc
Package codes provides status codes of grpc
net/grpc/credentials
Package credentials provides generic functionality for grpc credentials setting
Package credentials provides generic functionality for grpc credentials setting
net/grpc/errdetails
Package errdetails provides error detail for grpc status
Package errdetails provides error detail for grpc status
net/grpc/interceptor/server/logging
Package logging provides gRPC interceptors for access logging
Package logging provides gRPC interceptors for access logging
net/grpc/interceptor/server/recover
Package recover provides gRPC interceptors for recovery
Package recover provides gRPC interceptors for recovery
net/grpc/interceptor/server/trace
Package trace provides gRPC interceptors for traces
Package trace provides gRPC interceptors for traces
net/grpc/keepalive
Package keepalive provides grpc keepalive configuration
Package keepalive provides grpc keepalive configuration
net/grpc/metric
Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc
Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc
net/grpc/pool
Package pool provides grpc connection pool client Package pool provides grpc connection pool client
Package pool provides grpc connection pool client Package pool provides grpc connection pool client
net/grpc/proto
Package proto provides proto file logic
Package proto provides proto file logic
net/grpc/reflection
Package reflection provides grpc reflection for providing grpc server proto specs
Package reflection provides grpc reflection for providing grpc server proto specs
net/grpc/status
Package status provides statuses and errors returned by grpc handler functions
Package status provides statuses and errors returned by grpc handler functions
net/grpc/types
Package types provides alias of protobuf library types
Package types provides alias of protobuf library types
net/http/dump
Package dump provides http request/response dump logic
Package dump provides http request/response dump logic
net/http/metrics
Package metrics provides pprof profiler handler
Package metrics provides pprof profiler handler
net/http/middleware
Package middleware provides rest.Func Middleware Package routing provides implementation of Go API for routing http Handler wrapped by rest.Func Package middleware provides rest.Func Middleware
Package middleware provides rest.Func Middleware Package routing provides implementation of Go API for routing http Handler wrapped by rest.Func Package middleware provides rest.Func Middleware
net/http/rest
Package rest provides REST API common logic & variable
Package rest provides REST API common logic & variable
net/http/transport
Package transport provides http transport roundtrip option Package transport provides http transport roundtrip option Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package transport provides http transport roundtrip option Package transport provides http transport roundtrip option Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
observability
Package observability provides observability functions Package observability provides observability functions
Package observability provides observability functions Package observability provides observability functions
observability/client/google
Package google provides a google API client options.
Package google provides a google API client options.
observability/collector
Package collector provides metrics collector Package collector provides metrics collector
Package collector provides metrics collector Package collector provides metrics collector
observability/exporter
Package exporter provides exporters.
Package exporter provides exporters.
observability/exporter/jaeger
Package jaeger provides a jaeger exporter.
Package jaeger provides a jaeger exporter.
observability/exporter/prometheus
Package prometheus provides a prometheus exporter.
Package prometheus provides a prometheus exporter.
observability/exporter/stackdriver
Package stackdriver provides a stackdriver exporter.
Package stackdriver provides a stackdriver exporter.
observability/metrics
Package metrics provides metrics.
Package metrics provides metrics.
observability/metrics/agent/core/ngt
Package ngt provides functions for ngt stats
Package ngt provides functions for ngt stats
observability/metrics/agent/sidecar
Package sidecar provides functions for sidecar stats
Package sidecar provides functions for sidecar stats
observability/metrics/db/kvs/redis
Package redis provides redis metrics functions
Package redis provides redis metrics functions
observability/metrics/db/nosql/cassandra
Package cassandra provides cassandra metrics functions
Package cassandra provides cassandra metrics functions
observability/metrics/db/rdb/mysql
Package mysql provides mysql metrics functions
Package mysql provides mysql metrics functions
observability/metrics/grpc
Package grpc provides functions for grpc stats
Package grpc provides functions for grpc stats
observability/metrics/info
Package info provides general info metrics functions
Package info provides general info metrics functions
observability/metrics/manager/compressor
Package compressor provides functions for compressor stats
Package compressor provides functions for compressor stats
observability/metrics/manager/index
Package index provides functions for indexer stats
Package index provides functions for indexer stats
observability/metrics/mem
Package mem provides memory metrics functions
Package mem provides memory metrics functions
observability/metrics/runtime/cgo
Package cgo provides functions for runtime cgo stats
Package cgo provides functions for runtime cgo stats
observability/metrics/runtime/goroutine
Package goroutine provides functions for goroutine runtime stats
Package goroutine provides functions for goroutine runtime stats
observability/metrics/version
Package version provides version info metrics functions
Package version provides version info metrics functions
observability/profiler
Package profiler provides profilers.
Package profiler provides profilers.
observability/profiler/stackdriver
Package stackdriver provides a stackdriver exporter.
Package stackdriver provides a stackdriver exporter.
observability/trace
Package trace provides trace functions.
Package trace provides trace functions.
params
Package params provides implementation of Go API for argument parser Package params provides implementation of Go API for argument parser
Package params provides implementation of Go API for argument parser Package params provides implementation of Go API for argument parser
rand
Package rand provides random number algorithms
Package rand provides random number algorithms
runner
Package runner provides implementation of process runner Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package runner provides implementation of process runner Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
safety
Package safety provides safety functionality like revcover
Package safety provides safety functionality like revcover
servers
Package servers provides implementation of Go API for managing server flow Package servers provides implementation of Go API for managing server flow Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package servers provides implementation of Go API for managing server flow Package servers provides implementation of Go API for managing server flow Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
servers/server
Package servers provides implementation of Go API for managing server flow Package server provides implementation of Go API for managing server flow
Package servers provides implementation of Go API for managing server flow Package server provides implementation of Go API for managing server flow
servers/starter
Package starter provides server startup and shutdown flow control Package starter provides server startup and shutdown flow control
Package starter provides server startup and shutdown flow control Package starter provides server startup and shutdown flow control
singleflight
Package singleflight represents zero time caching.
Package singleflight represents zero time caching.
test
Package test provides functions for general testing use Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package test provides functions for general testing use Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
tls
Package tls provides implementation of Go API for tls certificate provider Package tls provides implementation of Go API for tls certificate provider
Package tls provides implementation of Go API for tls certificate provider Package tls provides implementation of Go API for tls certificate provider
version
Package version provides version comparison functionality
Package version provides version comparison functionality
worker
Package worker provides worker processes Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
Package worker provides worker processes Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.