exporter

Documentation

Index

• type Config
• type Encoder
• type Exporter
  • func New(c Encoder, path string, bkt objstore.Bucket) *Exporter
  • func (e *Exporter) Export(ctx context.Context, df dataframe.Dataframe) (err error)
• type Type

Types

type Config

type Config struct {
	Type    Type                `yaml:"type"`
	Path    string              `yaml:"path"`
	Storage client.BucketConfig `yaml:"storage"`
}

Config contains the options determining the object storage where files will be uploaded to.

type Encoder

type Encoder interface {
	// TODO(bwplotka): Consider more generic option with interface{} if we have more types than Dataframe.
	Encode(io.Writer, dataframe.Dataframe) (err error)
}

An Encoder writes serialized type to an output stream.

type Exporter

type Exporter struct {
	// contains filtered or unexported fields
}

func New

func New(c Encoder, path string, bkt objstore.Bucket) *Exporter

func (*Exporter) Export

func (e *Exporter) Export(ctx context.Context, df dataframe.Dataframe) (err error)

Export encodes and streams the dataframe to given bucket. On error partial result might occur. It's caller responsibility to clean after error.

type Type

type Type string

const (
	PARQUET Type = "PARQUET"
)