util

package
v1.8.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Mar 25, 2021 License: Apache-2.0 Imports: 11 Imported by: 37

Documentation

Index

Constants

This section is empty.

Variables

View Source
var QueryParallelism = 100

QueryParallelism is the maximum number of subqueries run in parallel per higher-level query

Functions

func DoParallelQueries

func DoParallelQueries(
	ctx context.Context, doSingleQuery DoSingleQuery, queries []chunk.IndexQuery,
	callback Callback,
) error

DoParallelQueries translates between our interface for query batching, and indexes that don't yet support batching.

func EnsureDirectory added in v0.7.0

func EnsureDirectory(dir string) error

EnsureDirectory makes sure directory is there, if not creates it if not

func GetParallelChunks

func GetParallelChunks(ctx context.Context, chunks []chunk.Chunk, f func(context.Context, *chunk.DecodeContext, chunk.Chunk) (chunk.Chunk, error)) ([]chunk.Chunk, error)

GetParallelChunks fetches chunks in parallel (up to maxParallel).

func NewReadCloserWithContextCancelFunc added in v1.5.0

func NewReadCloserWithContextCancelFunc(readCloser io.ReadCloser, cancel context.CancelFunc) io.ReadCloser

Types

type Callback

type Callback func(chunk.IndexQuery, chunk.ReadBatch) bool

Callback from an IndexQuery.

func QueryFilter

func QueryFilter(callback Callback) Callback

QueryFilter wraps a callback to ensure the results are filtered correctly; useful for the cache and Bigtable backend, which only ever fetches the whole row.

type DoSingleQuery

type DoSingleQuery func(context.Context, chunk.IndexQuery, Callback) error

DoSingleQuery is the interface for indexes that don't support batching yet.

type ReadCloserWithContextCancelFunc added in v1.5.0

type ReadCloserWithContextCancelFunc struct {
	io.ReadCloser
	// contains filtered or unexported fields
}

ReadCloserWithContextCancelFunc helps with cancelling the context when closing a ReadCloser. NOTE: The consumer of ReadCloserWithContextCancelFunc should always call the Close method when it is done reading which otherwise could cause a resource leak.

func (ReadCloserWithContextCancelFunc) Close added in v1.5.0

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL