README
¶
What is Vald?
Vald is a highly scalable distributed fast approximate nearest neighbor dense vector search engine.
Vald is designed and implemented based on Cloud-Native architecture.
It uses the fastest ANN Algorithm NGT to search neighbors.
Vald has automatic vector indexing and index backup, and horizontal scaling which made for searching from billions of feature vector data.
Vald is easy to use, feature-rich and highly customizable as you needed.
Go to Get Started page to try out Vald :)
(If you are interested in ANN benchmarks, please refer to the official website.)
Main Features
-
Asynchronous Auto Indexing
- Usually the graph requires locking during indexing, which causes stop-the-world. But Vald uses distributed index graphs so it continues to work during indexing.
-
Customizable Ingress/Egress Filtering
- Vald implements it's own highly customizable Ingress/Egress filter.
- Which can be configured to fit the gRPC interface.
- Ingress Filter: Ability to Vectorize through filter on request.
- Egress Filter: rerank or filter the searching result with your own algorithm.
-
Cloud-native based vector searching engine
- Horizontal scalable on memory and CPU for your demand.
-
Auto Backup for Index data
- Vald has a feature to store the backup of the index data using MySQL or Cassandra which enables disaster recovery.
-
Distributed Indexing
- Vald distribute vector index to multiple agents, each agent stores different index.
-
Index Replication
- Vald stores each index in multiple agents which enables index replicas.
- Automatically rebalance the replica when some Vald agent goes down.
-
Easy to use
- Vald can be easily installed in a few steps.
-
Highly customizable
- You can configure the number of vector dimensions, the number of replica and etc.
-
Multi language supported
- Go, Java, Clojure, Node.js, and Python client library are supported.
- gRPC APIs can be triggered by any programming languages which support gRPC.
- REST API is also supported.
Requirements
- Kubernetes 1.17~
- AVX2 instructions (required by Vald Agent NGT)
Get Started
Please refer to Get Started.
Installation
Using Helm
helm repo add vald https://vald.vdaas.org/charts
helm install vald-cluster vald/vald
If you use the default values.yaml, the nightly images will be installed.
Docker image tagging policy
nightly... latest build of master branchvX.X.X... released versionslatest... latest build of release versionsstable... latest long-term supported version
Using Helm-operator
Example
Write example here
Architecture Overview
Please refer here for more details of the architecture overview in the future.
Development
Before your first commit to this repository, it is strongly recommended to run the commands below.
make init
Components
| Component | Docker image |
|---|---|
| Agent NGT |
|
| Agent Sidecar |
|
| Discoverer |
|
| Gateways |
|
| Backup Managers |
|
| Compressor |
|
| Metas |
|
| Index Manager |
|
| Helm Operator |
|
Contribution
Please read the contribution guide
Contributors
Thanks goes to these wonderful people (emoji key):
 Yusuke Kato 💻 🎨 🚧 📆 |
 Rintaro Okamura 💻 📖 🚧 📦 |
 Kosuke Morimoto 💻 💡 🔧 ⚠️ |
 Kiichiro YUKAWA 📖 🚧 ⚠️ ✅ |
 datelier 💻 🤔 |
 Kevin Diu 📖 💡 ⚠️ ✅ |
 Hiroto Funakoshi 📖 🔧 ⚠️ ✅ |
 taisho 🎨 📖 💡 |
 Pierre Grimaud 📖 |
 Omer Katz 📖 ✅ |
LICENSE
vald released under Apache 2.0 license, refer LICENSE file.
Directories
¶
| Path | Synopsis |
|---|---|
|
apis
module
|
|
|
grpc/v1/vald
Package vald provides vald server interface
|
Package vald provides vald server interface |
|
cmd
|
|
|
agent/core/ngt
Package main provides program main
|
Package main provides program main |
|
agent/sidecar
Package main provides program main
|
Package main provides program main |
|
discoverer/k8s
Package main provides program main
|
Package main provides program main |
|
filter/ingress/tensorflow
Package main provides program main
|
Package main provides program main |
|
gateway/backup
Package main provides program main
|
Package main provides program main |
|
gateway/filter
Package main provides program main
|
Package main provides program main |
|
gateway/lb
Package main provides program main
|
Package main provides program main |
|
gateway/meta
Package main provides program main
|
Package main provides program main |
|
gateway/vald
Package main provides program main
|
Package main provides program main |
|
manager/backup/cassandra
Package main provides program main
|
Package main provides program main |
|
manager/backup/mysql
Package main provides program main
|
Package main provides program main |
|
manager/compressor
Package main provides program main
|
Package main provides program main |
|
manager/index
Package main provides program main
|
Package main provides program main |
|
manager/replication/agent
Package main provides program main
|
Package main provides program main |
|
manager/replication/controller
Package main provides program main
|
Package main provides program main |
|
meta/cassandra
Package main provides program main
|
Package main provides program main |
|
meta/redis
Package main provides program main
|
Package main provides program main |
|
example
|
|
|
client
Module
|
|
|
hack
|
|
|
benchmark/core/benchmark
Package benchmark provides benchmark frame Package benchmark provides benchmark frame Package benchmark provides benchmark frame
|
Package benchmark provides benchmark frame Package benchmark provides benchmark frame Package benchmark provides benchmark frame |
|
benchmark/core/benchmark/strategy
Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy
|
Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy Package strategy provides benchmark strategy |
|
benchmark/internal/client/ngtd/grpc
Package grpc provides grpc client functions Package grpc provides grpc client functions Package grpc provides grpc client functions
|
Package grpc provides grpc client functions Package grpc provides grpc client functions Package grpc provides grpc client functions |
|
benchmark/internal/client/ngtd/rest
Package rest provides rest client functions Package rest provides rest client functions
|
Package rest provides rest client functions Package rest provides rest client functions |
|
benchmark/internal/core/algorithm
Package algorithm provides core interface
|
Package algorithm provides core interface |
|
benchmark/internal/core/algorithm/gongt
Package gongt provides gongt Package gongt provides gongt
|
Package gongt provides gongt Package gongt provides gongt |
|
benchmark/internal/core/algorithm/ngt
Package ngt provides ngt Package ngt provides ngt
|
Package ngt provides ngt Package ngt provides ngt |
|
benchmark/internal/e2e
Package e2e provides e2e testing framework functions Package e2e provides e2e testing framework functions Package e2e provides e2e testing framework functions
|
Package e2e provides e2e testing framework functions Package e2e provides e2e testing framework functions Package e2e provides e2e testing framework functions |
|
benchmark/internal/e2e/strategy
Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions
|
Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions Package strategy provides strategy for e2e testing functions |
|
benchmark/internal/starter
Package starter provides starter interfaces
|
Package starter provides starter interfaces |
|
benchmark/internal/starter/agent/core/ngt
Package ngt provides ngt agent starter functionality Package ngt provides ngt agent starter functionality
|
Package ngt provides ngt agent starter functionality Package ngt provides ngt agent starter functionality |
|
benchmark/internal/starter/external/ngtd
Package ngtd provides ngtd starter functionality Package ngtd provides ngtd starter functionality
|
Package ngtd provides ngtd starter functionality Package ngtd provides ngtd starter functionality |
|
benchmark/internal/starter/gateway/vald
Package vald provides vald starter functionality Package vald provides vald starter functionality
|
Package vald provides vald starter functionality Package vald provides vald starter functionality |
|
internal
|
|
|
backoff
Package backoff provides backoff function controller Package backoff provides backoff function controller
|
Package backoff provides backoff function controller Package backoff provides backoff function controller |
|
cache
Package cache provides implementation of cache Package cache provides implementation of cache
|
Package cache provides implementation of cache Package cache provides implementation of cache |
|
cache/cacher
Package cacher provides implementation of cache type definition
|
Package cacher provides implementation of cache type definition |
|
cache/gache
Package gache provides implementation of cache using gache Package gache provides implementation of cache using gache
|
Package gache provides implementation of cache using gache Package gache provides implementation of cache using gache |
|
client/v1/client
Package client provides vald component client interfaces
|
Package client provides vald component client interfaces |
|
client/v1/client/agent/core
Package core provides agent ngt gRPC client functions Package core provides agent ngt gRPC client functions
|
Package core provides agent ngt gRPC client functions Package core provides agent ngt gRPC client functions |
|
client/v1/client/compressor
Package compressor represents compressor client Package compressor represents compressor client
|
Package compressor represents compressor client Package compressor represents compressor client |
|
client/v1/client/discoverer
Package discoverer Package discoverer
|
Package discoverer Package discoverer |
|
client/v1/client/filter/egress
Package egress provides egress filter client logic Package egress provides egress filter client logic
|
Package egress provides egress filter client logic Package egress provides egress filter client logic |
|
client/v1/client/filter/ingress
Package ingress provides ingress filter client logic Package ingress provides ingress filter client logic
|
Package ingress provides ingress filter client logic Package ingress provides ingress filter client logic |
|
client/v1/client/vald
Package vald provides vald grpc client library Package vald provides vald grpc client library
|
Package vald provides vald grpc client library Package vald provides vald grpc client library |
|
compress
Package compress provides compressor interface Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package compress provides compressor interface Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Package compress provides compress functions Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
config
Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic
|
Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic Package config providers configuration type and load configuration logic |
|
core/algorithm
Package algorithm defines vald's core ann algorithm interface & constraint.
|
Package algorithm defines vald's core ann algorithm interface & constraint. |
|
core/algorithm/ngt
Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT
|
Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT Package ngt provides implementation of Go API for https://github.com/yahoojapan/NGT |
|
core/converter/tensorflow
Package tensorflow provides implementation of Go API for extract data to vector Package tensorflow provides implementation of Go API for extract data to vector Package tensorflow provides implementation of Go API for extract data to vector
|
Package tensorflow provides implementation of Go API for extract data to vector Package tensorflow provides implementation of Go API for extract data to vector Package tensorflow provides implementation of Go API for extract data to vector |
|
db/kvs/redis
Package redis provides implementation of Go API for redis interface Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package redis provides implementation of Go API for redis interface Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
db/rdb/mysql
Package mysql provides the functions for handling vald's data with MySQL.
|
Package mysql provides the functions for handling vald's data with MySQL. |
|
db/rdb/mysql/dbr
Package dbr provides the dbr functions for handling with databases.
|
Package dbr provides the dbr functions for handling with databases. |
|
db/storage/blob/s3/reader
Package reader provides the reader functions for handling with s3.
|
Package reader provides the reader functions for handling with s3. |
|
errgroup
Package errgroup provides server global wait group for graceful kill all goroutine
|
Package errgroup provides server global wait group for graceful kill all goroutine |
|
errors
Package errors provides error types and function Package errors provides benchmark error Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides benchmark error Package errors provides error types and function Package errors provides error types and function Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package errors provides error types and function Package errors provides benchmark error Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides error types and function Package errors provides benchmark error Package errors provides error types and function Package errors provides error types and function Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
file
Package file provides file I/O functionality
|
Package file provides file I/O functionality |
|
info
Package info provides build-time info Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package info provides build-time info Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
io
Package io provides io functions Package io provides io functions
|
Package io provides io functions Package io provides io functions |
|
io/ioutil
Package ioutil provides utility function for I/O
|
Package ioutil provides utility function for I/O |
|
k8s
Package k8s provides kubernetes control functionality Package k8s provides kubernetes control functionality
|
Package k8s provides kubernetes control functionality Package k8s provides kubernetes control functionality |
|
k8s/metrics/node
Package node provides kubernetes node information and preriodically update Package node provides kubernetes node information and preriodically update
|
Package node provides kubernetes node information and preriodically update Package node provides kubernetes node information and preriodically update |
|
k8s/metrics/pod
Package pod provides kubernetes pod information and preriodically update Package pod provides kubernetes pod information and preriodically update
|
Package pod provides kubernetes pod information and preriodically update Package pod provides kubernetes pod information and preriodically update |
|
k8s/node
Package node provides kubernetes node information and preriodically update Package node provides kubernetes node information and preriodically update
|
Package node provides kubernetes node information and preriodically update Package node provides kubernetes node information and preriodically update |
|
k8s/pod
Package pod provides kubernetes pod information and preriodically update Package pod provides kubernetes pod information and preriodically update
|
Package pod provides kubernetes pod information and preriodically update Package pod provides kubernetes pod information and preriodically update |
|
net
Package net provides net functionality for vald's network connection Package net provides net functionality for vald's network connection Package tcp provides tcp option
|
Package net provides net functionality for vald's network connection Package net provides net functionality for vald's network connection Package tcp provides tcp option |
|
net/control
Package control provides network socket option Package control provides network socket option
|
Package control provides network socket option Package control provides network socket option |
|
net/grpc
Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc
|
Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc Package grpc provides generic functionality for grpc |
|
net/grpc/codes
Package codes provides status codes of grpc
|
Package codes provides status codes of grpc |
|
net/grpc/credentials
Package credentials provides generic functionality for grpc credentials setting
|
Package credentials provides generic functionality for grpc credentials setting |
|
net/grpc/errdetails
Package errdetails provides error detail for grpc status
|
Package errdetails provides error detail for grpc status |
|
net/grpc/interceptor/server/logging
Package logging provides gRPC interceptors for access logging
|
Package logging provides gRPC interceptors for access logging |
|
net/grpc/interceptor/server/recover
Package recover provides gRPC interceptors for recovery
|
Package recover provides gRPC interceptors for recovery |
|
net/grpc/interceptor/server/trace
Package trace provides gRPC interceptors for traces
|
Package trace provides gRPC interceptors for traces |
|
net/grpc/keepalive
Package keepalive provides grpc keepalive configuration
|
Package keepalive provides grpc keepalive configuration |
|
net/grpc/metric
Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc
|
Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc Package metric provides metrics functions for grpc |
|
net/grpc/pool
Package pool provides grpc connection pool client Package pool provides grpc connection pool client
|
Package pool provides grpc connection pool client Package pool provides grpc connection pool client |
|
net/grpc/proto
Package proto provides proto file logic
|
Package proto provides proto file logic |
|
net/grpc/reflection
Package reflection provides grpc reflection for providing grpc server proto specs
|
Package reflection provides grpc reflection for providing grpc server proto specs |
|
net/grpc/status
Package status provides statuses and errors returned by grpc handler functions
|
Package status provides statuses and errors returned by grpc handler functions |
|
net/grpc/types
Package types provides alias of protobuf library types
|
Package types provides alias of protobuf library types |
|
net/http/dump
Package dump provides http request/response dump logic
|
Package dump provides http request/response dump logic |
|
net/http/metrics
Package metrics provides pprof profiler handler
|
Package metrics provides pprof profiler handler |
|
net/http/middleware
Package middleware provides rest.Func Middleware Package routing provides implementation of Go API for routing http Handler wrapped by rest.Func Package middleware provides rest.Func Middleware
|
Package middleware provides rest.Func Middleware Package routing provides implementation of Go API for routing http Handler wrapped by rest.Func Package middleware provides rest.Func Middleware |
|
net/http/rest
Package rest provides REST API common logic & variable
|
Package rest provides REST API common logic & variable |
|
net/http/transport
Package transport provides http transport roundtrip option Package transport provides http transport roundtrip option Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package transport provides http transport roundtrip option Package transport provides http transport roundtrip option Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
observability
Package observability provides observability functions Package observability provides observability functions
|
Package observability provides observability functions Package observability provides observability functions |
|
observability/client/google
Package google provides a google API client options.
|
Package google provides a google API client options. |
|
observability/collector
Package collector provides metrics collector Package collector provides metrics collector
|
Package collector provides metrics collector Package collector provides metrics collector |
|
observability/exporter
Package exporter provides exporters.
|
Package exporter provides exporters. |
|
observability/exporter/jaeger
Package jaeger provides a jaeger exporter.
|
Package jaeger provides a jaeger exporter. |
|
observability/exporter/prometheus
Package prometheus provides a prometheus exporter.
|
Package prometheus provides a prometheus exporter. |
|
observability/exporter/stackdriver
Package stackdriver provides a stackdriver exporter.
|
Package stackdriver provides a stackdriver exporter. |
|
observability/metrics
Package metrics provides metrics.
|
Package metrics provides metrics. |
|
observability/metrics/agent/core/ngt
Package ngt provides functions for ngt stats
|
Package ngt provides functions for ngt stats |
|
observability/metrics/agent/sidecar
Package sidecar provides functions for sidecar stats
|
Package sidecar provides functions for sidecar stats |
|
observability/metrics/db/kvs/redis
Package redis provides redis metrics functions
|
Package redis provides redis metrics functions |
|
observability/metrics/db/nosql/cassandra
Package cassandra provides cassandra metrics functions
|
Package cassandra provides cassandra metrics functions |
|
observability/metrics/db/rdb/mysql
Package mysql provides mysql metrics functions
|
Package mysql provides mysql metrics functions |
|
observability/metrics/grpc
Package grpc provides functions for grpc stats
|
Package grpc provides functions for grpc stats |
|
observability/metrics/info
Package info provides general info metrics functions
|
Package info provides general info metrics functions |
|
observability/metrics/manager/compressor
Package compressor provides functions for compressor stats
|
Package compressor provides functions for compressor stats |
|
observability/metrics/manager/index
Package index provides functions for indexer stats
|
Package index provides functions for indexer stats |
|
observability/metrics/mem
Package mem provides memory metrics functions
|
Package mem provides memory metrics functions |
|
observability/metrics/runtime/cgo
Package cgo provides functions for runtime cgo stats
|
Package cgo provides functions for runtime cgo stats |
|
observability/metrics/runtime/goroutine
Package goroutine provides functions for goroutine runtime stats
|
Package goroutine provides functions for goroutine runtime stats |
|
observability/metrics/version
Package version provides version info metrics functions
|
Package version provides version info metrics functions |
|
observability/profiler
Package profiler provides profilers.
|
Package profiler provides profilers. |
|
observability/profiler/stackdriver
Package stackdriver provides a stackdriver exporter.
|
Package stackdriver provides a stackdriver exporter. |
|
observability/trace
Package trace provides trace functions.
|
Package trace provides trace functions. |
|
params
Package params provides implementation of Go API for argument parser Package params provides implementation of Go API for argument parser
|
Package params provides implementation of Go API for argument parser Package params provides implementation of Go API for argument parser |
|
rand
Package rand provides random number algorithms
|
Package rand provides random number algorithms |
|
runner
Package runner provides implementation of process runner Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package runner provides implementation of process runner Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
safety
Package safety provides safety functionality like revcover
|
Package safety provides safety functionality like revcover |
|
servers
Package servers provides implementation of Go API for managing server flow Package servers provides implementation of Go API for managing server flow Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package servers provides implementation of Go API for managing server flow Package servers provides implementation of Go API for managing server flow Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
servers/server
Package servers provides implementation of Go API for managing server flow Package server provides implementation of Go API for managing server flow
|
Package servers provides implementation of Go API for managing server flow Package server provides implementation of Go API for managing server flow |
|
servers/starter
Package starter provides server startup and shutdown flow control Package starter provides server startup and shutdown flow control
|
Package starter provides server startup and shutdown flow control Package starter provides server startup and shutdown flow control |
|
singleflight
Package singleflight represents zero time caching.
|
Package singleflight represents zero time caching. |
|
test
Package test provides functions for general testing use Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package test provides functions for general testing use Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
tls
Package tls provides implementation of Go API for tls certificate provider Package tls provides implementation of Go API for tls certificate provider
|
Package tls provides implementation of Go API for tls certificate provider Package tls provides implementation of Go API for tls certificate provider |
|
version
Package version provides version comparison functionality
|
Package version provides version comparison functionality |
|
worker
Package worker provides worker processes Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.
|
Package worker provides worker processes Copyright (C) 2019-2021 vdaas.org vald team <vald@vdaas.org> Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. |
|
pkg
|
|
|
agent/core/ngt/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
agent/core/ngt/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
agent/core/ngt/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
agent/core/ngt/model
Package model defines object structure
|
Package model defines object structure |
|
agent/core/ngt/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
agent/core/ngt/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
agent/core/ngt/service/vqueue
Package vqueue manages the vector cache layer for reducing FFI overhead for fast Agent processing.
|
Package vqueue manages the vector cache layer for reducing FFI overhead for fast Agent processing. |
|
agent/internal/metadata
Package metadata provides agent metadata structs and info.
|
Package metadata provides agent metadata structs and info. |
|
agent/sidecar/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
agent/sidecar/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
agent/sidecar/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
agent/sidecar/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
agent/sidecar/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
agent/sidecar/service/observer
Package observer provides storage observer Package observer provides storage observer Package observer provides storage observer
|
Package observer provides storage observer Package observer provides storage observer Package observer provides storage observer |
|
agent/sidecar/service/restorer
Package restorer provides restorer service Package restorer provides restorer service
|
Package restorer provides restorer service Package restorer provides restorer service |
|
agent/sidecar/service/storage
Package storage provides blob storage service Package storage provides blob storage service Package storage provides blob storage service
|
Package storage provides blob storage service Package storage provides blob storage service Package storage provides blob storage service |
|
discoverer/k8s/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
discoverer/k8s/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
discoverer/k8s/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
discoverer/k8s/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
discoverer/k8s/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
filter/ingress/tensorflow/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
filter/ingress/tensorflow/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
filter/ingress/tensorflow/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
filter/ingress/tensorflow/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
gateway/backup/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
gateway/backup/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
gateway/backup/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
gateway/backup/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
gateway/filter/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
gateway/filter/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
gateway/filter/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
gateway/filter/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
gateway/lb/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
gateway/lb/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
gateway/lb/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
gateway/lb/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
gateway/lb/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
gateway/lb/usecase
Package usecase represents gateways usecase layer
|
Package usecase represents gateways usecase layer |
|
gateway/meta/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
gateway/meta/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
gateway/meta/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
gateway/meta/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
gateway/meta/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
gateway/vald/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
gateway/vald/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
gateway/vald/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
gateway/vald/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
gateway/vald/service
Package service Package service manages the main logic of server.
|
Package service Package service manages the main logic of server. |
|
manager/backup/cassandra/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
manager/backup/cassandra/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
manager/backup/cassandra/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
manager/backup/cassandra/model
Package grpc provides grpc server logic
|
Package grpc provides grpc server logic |
|
manager/backup/cassandra/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
manager/backup/cassandra/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
manager/backup/mysql/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
manager/backup/mysql/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
manager/backup/mysql/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
manager/backup/mysql/model
Package grpc provides grpc server logic
|
Package grpc provides grpc server logic |
|
manager/backup/mysql/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
manager/backup/mysql/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
manager/compressor/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
manager/compressor/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
manager/compressor/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
manager/compressor/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
manager/compressor/service
Package service Package service Package service manages the main logic of server.
|
Package service Package service Package service manages the main logic of server. |
|
manager/index/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
manager/index/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
manager/index/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
manager/index/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
manager/index/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
manager/replication/agent/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
manager/replication/agent/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
manager/replication/agent/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
manager/replication/agent/model
Package grpc provides grpc server logic
|
Package grpc provides grpc server logic |
|
manager/replication/agent/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
manager/replication/agent/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
manager/replication/controller/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
manager/replication/controller/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
manager/replication/controller/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
manager/replication/controller/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
manager/replication/controller/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
meta/cassandra/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
meta/cassandra/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
meta/cassandra/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
meta/cassandra/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
meta/cassandra/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
meta/redis/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
meta/redis/handler/grpc
Package grpc provides grpc server logic Package grpc provides grpc server logic
|
Package grpc provides grpc server logic Package grpc provides grpc server logic |
|
meta/redis/handler/rest
Package rest provides rest api logic Package rest provides rest api logic
|
Package rest provides rest api logic Package rest provides rest api logic |
|
meta/redis/router
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func
|
Package router provides implementation of Go API for routing http Handler wrapped by rest.Func Package router provides implementation of Go API for routing http Handler wrapped by rest.Func |
|
meta/redis/service
Package service manages the main logic of server.
|
Package service manages the main logic of server. |
|
tools/cli/loadtest/config
Package setting stores all server application settings
|
Package setting stores all server application settings |
|
tests
|
|
Click to show internal directories.
Click to hide internal directories.