shuffle

Documentation

Index

• type Argument
  • func (arg *Argument) AppendChild(child vm.Operator)
  • func (arg *Argument) Call(proc *process.Process) (vm.CallResult, error)
  • func (arg *Argument) Free(proc *process.Process, pipelineFailed bool, err error)
  • func (arg *Argument) Prepare(proc *process.Process) error
  • func (arg *Argument) SetInfo(info *vm.OperatorInfo)
  • func (arg *Argument) String(buf *bytes.Buffer)

Types

type Argument

type Argument struct {
	ShuffleColIdx int32
	ShuffleType   int32
	ShuffleColMin int64
	ShuffleColMax int64
	AliveRegCnt   int32
	// contains filtered or unexported fields
}

func (*Argument) AppendChild

func (arg *Argument) AppendChild(child vm.Operator)

func (*Argument) Call

func (arg *Argument) Call(proc *process.Process) (vm.CallResult, error)

there are two ways for shuffle to send a batch if a batch belongs to one bucket, send this batch directly, and shuffle need to do nothing else split this batch into pieces, write data into pool. if one bucket is full, send this bucket. next time, set this bucket rowcount to 0 and reuse it for now, we shuffle null to the first bucket

func (*Argument) Free

func (arg *Argument) Free(proc *process.Process, pipelineFailed bool, err error)

func (*Argument) Prepare

func (arg *Argument) Prepare(proc *process.Process) error

func (*Argument) SetInfo

func (arg *Argument) SetInfo(info *vm.OperatorInfo)

func (*Argument) String

func (arg *Argument) String(buf *bytes.Buffer)