pps

package
Version: v1.6.9 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Feb 27, 2018 License: Apache-2.0 Imports: 17 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func DescribeSyntaxError added in v1.6.9

func DescribeSyntaxError(originalErr error, parsedBuffer bytes.Buffer) error

DescribeSyntaxError describes a syntax error encountered parsing json.

func GetExpectedNumWorkers added in v1.5.0

func GetExpectedNumWorkers(kubeClient *kube.Clientset, spec *ppsclient.ParallelismSpec) (int, error)

GetExpectedNumWorkers computes the expected number of workers that pachyderm will start given the ParallelismSpec 'spec'.

This is only exported for testing

func JobRepo

func JobRepo(job *ppsclient.Job) *pfs.Repo

JobRepo creates a pfs repo for a given job.

func PipelineRcName added in v1.5.0

func PipelineRcName(name string, version uint64) string

PipelineRcName generates the name of the k8s replication controller that manages a pipeline's workers

func PipelineRepo

func PipelineRepo(pipeline *ppsclient.Pipeline) *pfs.Repo

PipelineRepo creates a pfs repo for a given pipeline.

func PipelineReqFromInfo added in v1.6.9

func PipelineReqFromInfo(pipelineInfo *ppsclient.PipelineInfo) *ppsclient.CreatePipelineRequest

PipelineReqFromInfo converts a PipelineInfo into a CreatePipelineRequest.

Types

type Hasher

type Hasher struct {
	JobModulus      uint64
	PipelineModulus uint64
}

A Hasher represents a job/pipeline hasher.

func NewHasher

func NewHasher(jobModulus uint64, pipelineModulus uint64) *Hasher

NewHasher creates a hasher.

func (*Hasher) HashJob

func (s *Hasher) HashJob(jobID string) uint64

HashJob computes and returns the hash of a job.

func (*Hasher) HashPipeline

func (s *Hasher) HashPipeline(pipelineName string) uint64

HashPipeline computes and returns the hash of a pipeline.

type PipelineManifestReader added in v1.6.9

type PipelineManifestReader struct {
	// contains filtered or unexported fields
}

PipelineManifestReader helps with unmarshalling pipeline configs from JSON. It's used by create-pipeline and update-pipeline

func NewPipelineManifestReader added in v1.6.9

func NewPipelineManifestReader(path string) (result *PipelineManifestReader, retErr error)

NewPipelineManifestReader creates a new manifest reader from a path.

func (*PipelineManifestReader) NextCreatePipelineRequest added in v1.6.9

func (r *PipelineManifestReader) NextCreatePipelineRequest() (*ppsclient.CreatePipelineRequest, error)

NextCreatePipelineRequest gets the next request from the manifest reader.

Source Files

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL