generator

Documentation

Overview

Package generator contains an implementation of an in-memory generator that generates payloads in json format.

Index

• func NewMemGen(vertexInstance *dfv1.VertexInstance, writers map[string][]isb.BufferWriter, ...) (sourcer.Sourcer, error)
• type Data
• type Option
  • func WithLogger(l *zap.SugaredLogger) Option
  • func WithReadTimeout(timeout time.Duration) Option

Functions

func NewMemGen

func NewMemGen(
	vertexInstance *dfv1.VertexInstance,
	writers map[string][]isb.BufferWriter,
	fsd forwarder.ToWhichStepDecider,
	transformerApplier applier2.SourceTransformApplier,
	fetchWM fetch.SourceFetcher,
	toVertexPublisherStores map[string]store.WatermarkStore,
	publishWMStores store.WatermarkStore,
	idleManager wmb.IdleManager,
	opts ...Option) (sourcer.Sourcer, error)

NewMemGen function creates an instance of generator.

Types

type Data

type Data struct {
	Value uint64 `json:"value,omitempty"`
	// only to ensure a desired message size
	Padding []byte `json:"padding,omitempty"`
}

type Option

type Option func(*memGen) error

func WithLogger

func WithLogger(l *zap.SugaredLogger) Option

WithLogger is used to return logger information

func WithReadTimeout

func WithReadTimeout(timeout time.Duration) Option