dynamic

package
v0.1.18 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Dec 16, 2019 License: Apache-2.0 Imports: 23 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func New

func New(underlying TaskNodeHandler, nodeExecutor executors.Node, scope promutils.Scope) handler.Node

Types

type ContextualWorkflowStatus

type ContextualWorkflowStatus struct {
	v1alpha1.ExecutableWorkflowStatus
	// contains filtered or unexported fields
}

A contextual workflow status to override some of the implementations.

func (ContextualWorkflowStatus) ConstructNodeDataDir

Overrides default node data dir to work around the contractual assumption between Propeller and Futures to write all sub-node inputs into current node data directory. E.g.

if current node data dir is /wf_exec/node-1/data/
and the task ran and yielded 2 nodes, the structure will look like this:
/wf_exec/node-1/data/
                |_ inputs.pb
                |_ futures.pb
                |_ sub-node1/inputs.pb
                |_ sub-node2/inputs.pb

TODO: This is just a stop-gap until we transition the DynamicJobSpec to be a full-fledged workflow spec. TODO: this will allow us to have proper data bindings between nodes then we can stop making assumptions about data refs.

func (ContextualWorkflowStatus) GetDataDir

type TaskNodeHandler added in v0.1.13

type TaskNodeHandler interface {
	handler.Node
	ValidateOutputAndCacheAdd(ctx context.Context, nodeID v1alpha1.NodeID, i io.InputReader, r io.OutputReader, outputCommitter io.OutputWriter,
		tr pluginCore.TaskReader, m catalog.Metadata) (*io.ExecutionError, error)
}

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL