worker

Documentation

Index

• type DataflowFunc
• type Id
• type SimpleWorker
  • func NewSimpleWorker(ctx context.Context) *SimpleWorker
  • func (w *SimpleWorker) Dataflow(fn DataflowFunc) error
  • func (w *SimpleWorker) Done() <-chan struct{}
  • func (w *SimpleWorker) GenerateVID() vertex.Id
  • func (w *SimpleWorker) GetWorkerHandle() handles.WorkerHandle
  • func (w *SimpleWorker) Name() string
  • func (w *SimpleWorker) RegisterEdge(src vertex.Vertex, target vertex.Vertex, handle handles.VertexHandle) error
  • func (w *SimpleWorker) RegisterVertex(v vertex.Vertex, handle handles.VertexHandle) error
  • func (w *SimpleWorker) Run() error
  • func (w *SimpleWorker) ToScope() scope.Scope
• type Worker

Types

type DataflowFunc

type DataflowFunc = func(s scope.Scope) error

type Id

type Id int

type SimpleWorker

type SimpleWorker struct {
	// contains filtered or unexported fields
}

func NewSimpleWorker

func NewSimpleWorker(ctx context.Context) *SimpleWorker

func (*SimpleWorker) Dataflow

func (w *SimpleWorker) Dataflow(fn DataflowFunc) error

Dataflow builds the dataflow as described in the function fn. Registers vertices and build edges in running the function.

func (*SimpleWorker) Done

func (w *SimpleWorker) Done() <-chan struct{}

func (*SimpleWorker) GenerateVID

func (w *SimpleWorker) GenerateVID() vertex.Id

func (*SimpleWorker) GetWorkerHandle

func (w *SimpleWorker) GetWorkerHandle() handles.WorkerHandle

func (*SimpleWorker) Name

func (w *SimpleWorker) Name() string

============== Impl Scope interface ================//

func (*SimpleWorker) RegisterEdge

func (w *SimpleWorker) RegisterEdge(
	src vertex.Vertex,
	target vertex.Vertex,
	handle handles.VertexHandle,
) error

func (*SimpleWorker) RegisterVertex

func (w *SimpleWorker) RegisterVertex(
	v vertex.Vertex,
	handle handles.VertexHandle,
) error

func (*SimpleWorker) Run

func (w *SimpleWorker) Run() error

func (*SimpleWorker) ToScope

func (w *SimpleWorker) ToScope() scope.Scope

Currently worker implements both Worker and Scope interfaces and this works pretty fine. This ToScope() is a place holder function for future use if we want to separate scope from worker.

type Worker

type Worker interface {
	Dataflow(fn DataflowFunc) error
	ToScope() scope.Scope
	Run() error
}

Worker is a worker unit containing a dataflow graph, taking inputs and making computations.