manager

package
v0.25.2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Feb 20, 2021 License: MPL-2.0 Imports: 24 Imported by: 84

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type DedupManager

type DedupManager struct {
	// contains filtered or unexported fields
}

DedupManager is used to de-duplicate which instance of Consul-Template is handling each template. For each template, a lock path is determined using the MD5 of the template. This path is used to elect a "leader" instance.

The leader instance operations like usual, but any time a template is rendered, any of the data required for rendering is stored in the Consul KV store under the lock path.

The follower instances depend on the leader to do the primary watching and rendering, and instead only watch the aggregated data in the KV. Followers wait for updates and re-render the template.

If a template depends on 50 views, and is running on 50 machines, that would normally require 2500 blocking queries. Using deduplication, one instance has 50 view queries, plus 50 additional queries on the lock path for a total of 100.

func NewDedupManager

func NewDedupManager(config *config.DedupConfig, clients *dep.ClientSet, brain *template.Brain, templates []*template.Template) (*DedupManager, error)

NewDedupManager creates a new Dedup manager

func (*DedupManager) IsLeader

func (d *DedupManager) IsLeader(tmpl *template.Template) bool

IsLeader checks if we are currently the leader instance

func (*DedupManager) Start

func (d *DedupManager) Start() error

Start is used to start the de-duplication manager

func (*DedupManager) Stop

func (d *DedupManager) Stop() error

Stop is used to stop the de-duplication manager

func (*DedupManager) UpdateCh

func (d *DedupManager) UpdateCh() <-chan struct{}

UpdateCh returns a channel to watch for dependency updates

func (*DedupManager) UpdateDeps

func (d *DedupManager) UpdateDeps(t *template.Template, deps []dep.Dependency) error

UpdateDeps is used to update the values of the dependencies for a template

type ErrChildDied

type ErrChildDied struct {
	// contains filtered or unexported fields
}

ErrChildDied is the error returned when the child process prematurely dies.

func NewErrChildDied

func NewErrChildDied(c int) *ErrChildDied

NewErrChildDied creates a new error with the given exit code.

func (*ErrChildDied) Error

func (e *ErrChildDied) Error() string

Error implements the error interface.

func (*ErrChildDied) ExitStatus

func (e *ErrChildDied) ExitStatus() int

ExitStatus implements the ErrExitable interface.

type ErrExitable

type ErrExitable interface {
	ExitStatus() int
}

ErrExitable is an interface that defines an integer ExitStatus() function.

type RenderEvent

type RenderEvent struct {
	// Missing is the list of dependencies that we do not yet have data for, but
	// are contained in the watcher. This is different from unwatched dependencies,
	// which includes dependencies the watcher has not yet started querying for
	// data.
	MissingDeps *dep.Set

	// Template is the template attempting to be rendered.
	Template *template.Template

	// Contents is the raw, rendered contents from the template.
	Contents []byte

	// TemplateConfigs is the list of template configs that correspond to this
	// template.
	TemplateConfigs []*config.TemplateConfig

	// Unwatched is the list of dependencies that are not present in the watcher.
	// This value may change over time due to the n-pass evaluation.
	UnwatchedDeps *dep.Set

	// UpdatedAt is the last time this render event was updated.
	UpdatedAt time.Time

	// Used is the full list of dependencies seen in the template. Because of
	// the n-pass evaluation, this number can change over time. The dependencies
	// in this list may or may not have data. This just contains the list of all
	// dependencies parsed out of the template with the current data.
	UsedDeps *dep.Set

	// WouldRender determines if the template would have been rendered. A template
	// would have been rendered if all the dependencies are satisfied, but may
	// not have actually rendered if the file was already present or if an error
	// occurred when trying to write the file.
	WouldRender bool

	// LastWouldRender marks the last time the template would have rendered.
	LastWouldRender time.Time

	// DidRender determines if the Template was actually written to disk. In dry
	// mode, this will always be false, since templates are not written to disk
	// in dry mode. A template is only rendered to disk if all dependencies are
	// satisfied and the template is not already in place with the same contents.
	DidRender bool

	// LastDidRender marks the last time the template was written to disk.
	LastDidRender time.Time

	// ForQuiescence determines if this event is returned early in the
	// render loop due to quiescence. When evaluating if all templates have
	// been rendered we need to know if the event is triggered by quiesence
	// and if we can skip evaluating it as a render event for those purposes
	ForQuiescence bool
}

RenderEvent captures the time and events that occurred for a template rendering.

type Runner

type Runner struct {
	// ErrCh and DoneCh are channels where errors and finish notifications occur.
	ErrCh  chan error
	DoneCh chan struct{}

	// Env represents a custom set of environment variables to populate the
	// template and command runtime with. These environment variables will be
	// available in both the command's environment as well as the template's
	// environment.
	// NOTE this is only used when CT is being used as a library.
	Env map[string]string
	// contains filtered or unexported fields
}

Runner responsible rendering Templates and invoking Commands.

func NewRunner

func NewRunner(config *config.Config, dry bool) (*Runner, error)

NewRunner accepts a slice of TemplateConfigs and returns a pointer to the new Runner and any error that occurred during creation.

func (*Runner) Receive

func (r *Runner) Receive(d dep.Dependency, data interface{})

Receive accepts a Dependency and data for that dep. This data is cached on the Runner. This data is then used to determine if a Template is "renderable" (i.e. all its Dependencies have been downloaded at least once).

func (*Runner) RenderEventCh added in v0.19.1

func (r *Runner) RenderEventCh() <-chan struct{}

RenderEventCh returns a channel that will be triggered when there is a new render event.

func (*Runner) RenderEvents

func (r *Runner) RenderEvents() map[string]*RenderEvent

RenderEvents returns the render events for each template was rendered. The map is keyed by template ID.

func (*Runner) Run

func (r *Runner) Run() error

Run iterates over each template in this Runner and conditionally executes the template rendering and command execution.

The template is rendered atomically. If and only if the template render completes successfully, the optional commands will be executed, if given. Please note that all templates are rendered **and then** any commands are executed.

func (*Runner) SetErrStream added in v0.19.4

func (r *Runner) SetErrStream(err io.Writer)

SetErrStream modifies runner error stream. Defaults to stderr.

func (*Runner) SetOutStream added in v0.19.4

func (r *Runner) SetOutStream(out io.Writer)

SetOutStream modifies runner output stream. Defaults to stdout.

func (*Runner) Signal

func (r *Runner) Signal(s os.Signal) error

Signal sends a signal to the child process, if it exists. Any errors that occur are returned.

func (*Runner) Start

func (r *Runner) Start()

Start begins the polling for this runner. Any errors that occur will cause this function to push an item onto the runner's error channel and the halt execution. This function is blocking and should be called as a goroutine.

func (*Runner) Stop

func (r *Runner) Stop()

Stop halts the execution of this runner and its subprocesses.

func (*Runner) StopImmediately added in v0.22.0

func (r *Runner) StopImmediately()

StopImmediately behaves like Stop but won't wait for any splay on any child process it may be running.

func (*Runner) TemplateConfigMapping

func (r *Runner) TemplateConfigMapping() map[string][]*config.TemplateConfig

TemplateConfigMapping returns a mapping between the template ID and the set of TemplateConfig represented by the template ID

func (*Runner) TemplateRenderedCh

func (r *Runner) TemplateRenderedCh() <-chan struct{}

TemplateRenderedCh returns a channel that will be triggered when one or more templates are rendered.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL