regression

Documentation

Overview

Package regression contains pipeline regression tests.

Index

• func DirectParDo() *beam.Pipeline
• func DirectParDoAfterGBK() *beam.Pipeline
• func EmitParDo() *beam.Pipeline
• func EmitParDoAfterGBK() *beam.Pipeline
• func LPErrorPipeline(s beam.Scope) beam.PCollection
• func MixedOutputParDo() *beam.Pipeline
• func MultiEmitParDo() *beam.Pipeline

Functions

func DirectParDo

func DirectParDo() *beam.Pipeline

DirectParDo tests direct form output DoFns.

func DirectParDoAfterGBK

func DirectParDoAfterGBK() *beam.Pipeline

DirectParDoAfterGBK generates a pipeline with a direct-form ParDo after a GBK. See: BEAM-3978 and BEAM-4175.

func EmitParDo

func EmitParDo() *beam.Pipeline

EmitParDo tests emit form output DoFns.

func EmitParDoAfterGBK

func EmitParDoAfterGBK() *beam.Pipeline

EmitParDoAfterGBK generates a pipeline with a emit-form ParDo after a GBK. See: BEAM-3978 and BEAM-4175.

func LPErrorPipeline

func LPErrorPipeline(s beam.Scope) beam.PCollection

LPErrorPipeline constructs a pipeline that has a GBK followed by a CoGBK using the same input, with schema encoded structs as elements. This ends up having the stage after the CoGBK fail since the decoder post-cogbk is missing a Length Prefix coder that was applied to the GBK input, but not the CoGBK output. Root is likely in that there's no Beam standard CoGBK format for inject and expand. JIRA: BEAM-12438

func MixedOutputParDo

func MixedOutputParDo() *beam.Pipeline

MixedOutputParDo tests mixed direct + emit form output DoFns.

func MultiEmitParDo

func MultiEmitParDo() *beam.Pipeline

MultiEmitParDo tests double emit form output DoFns.