schema

Documentation

Overview

Package schema has the cross language implementation for calling schema transforms in other language SDKs.

Index

• func Transform(scope beam.Scope, config any, transformIdentifier string, opts ...Option) map[string]beam.PCollection
• type Option
  • func ExpansionAddr(addr string) Option
  • func Input(name string, in beam.PCollection) Option
  • func OutputType(name string, tpe beam.FullType) Option
  • func UnnamedOutputType(tpe beam.FullType) Option

Functions

func Transform

func Transform(scope beam.Scope, config any, transformIdentifier string, opts ...Option) map[string]beam.PCollection

Transform configures a new cross language transform to call a "schema transform" in an external SDK.

Types

type Option

type Option func(*options)

Option is the base type of all the schema transform options.

func ExpansionAddr

func ExpansionAddr(addr string) Option

ExpansionAddr is the URL of the expansion service to use.

func Input

func Input(name string, in beam.PCollection) Option

Input adds a named PCollection input to the transform.

func OutputType

func OutputType(name string, tpe beam.FullType) Option

OutputType specifies an output PCollection type of the transform. It must match the external transform's output schema.

func UnnamedOutputType

func UnnamedOutputType(tpe beam.FullType) Option

UnnamedOutputType specifies an output PCollection type of the transform. It must match the external transform's output schema. This is simply syntactic sugar for OutputType(beam.UnnamedOutputTag(), tpe).