monitor

package
v0.0.0-...-bc3f6f8 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Sep 10, 2019 License: Apache-2.0 Imports: 15 Imported by: 0

Documentation

Overview

Package monitor package handle the logging, collection and computation of statistical data. Every application can send some Measure (for the moment, we mostly measure the CPU time but it can be applied later for any kind of measures). The Monitor receives them and updates a Stats struct. This Stats struct can hold many different kinds of Measurements (the measure of a specific action such as "round time" or "verify time" etc). These measurements contain Values which compute the actual min/max/dev/avg values.

The Proxy allows to relay Measure from clients to the listening Monitor. A starter feature is also the DataFilter which can apply some filtering rules to the data before making any statistics about them.

Index

Constants

View Source 
const DefaultSinkPort = 10000

DefaultSinkPort is the default port where a monitor will listen and a proxy will contact the monitor.

View Source 
const Sink = "0.0.0.0"

Sink is the address where to listen for the monitor. The endpoint can be a monitor.Proxy or a direct connection with measure.go

Variables

This section is empty.

Functions

func ConnectSink 

func ConnectSink(addr string) error

ConnectSink connects to the given endpoint and initialises a json encoder. It can be the address of a proxy or a monitoring process. Returns an error if it could not connect to the endpoint.

func EndAndCleanup 

func EndAndCleanup()

EndAndCleanup sends a message to end the logging and closes the connection

func RecordSingleMeasure 

func RecordSingleMeasure(name string, value float64)

RecordSingleMeasure sends the pair name - value to the monitor directly.

Types

type Counter 

type Counter interface {
	Values() map[string]float64
}

Counter is an interface that can be used to report multiple values that keeps evolving. The keys in the returned map is the name of the value to record.

type CounterMeasure 

type CounterMeasure struct {
	// contains filtered or unexported fields
}

CounterMeasure is a struct that takes a Counter and can send the measurements to the monitor. Each time Record() is called, the measurements are put back to 0 (while the Counter still sends increased bytes number).

func NewCounterMeasure 

func NewCounterMeasure(name string, counter Counter) *CounterMeasure

NewCounterMeasure returns an CounterMeasure fresh. The base value are set to the values returned by counter.Values().

func (*CounterMeasure) Record 

func (cm *CounterMeasure) Record()

Record send the actual number of bytes read and written (**name**_written & **name**_read) and reset the counters.

type DataFilter 

type DataFilter interface {
	Filter(measure string, values []float64) []float64
}

DataFilter is a generic interface that can filter data according to some rules. For example, filter out everything outside the 90-th percentile.

type Measure 

type Measure interface {
	// Record must be called when you want to send the value
	// over the monitor listening.
	// Implementation of this interface must RESET the value to `0` at the end
	// of Record(). `0` means the initial value / meaning this measure had when
	// created.
	// Example: TimeMeasure.Record() will reset the time to `time.Now()`
	//          CounterMeasure.Record() will  reset the counter of the bytes
	//          read / written to 0.
	//          etc
	Record()
}

Measure is an interface for measurements Usage: 

measure := monitor.SingleMeasure("bandwidth")

or 

measure := monitor.NewTimeMeasure("round")
measure.Record()

type Monitor 

type Monitor struct {
	sync.Mutex
	// contains filtered or unexported fields
}

Monitor struct is used to collect measures and make the statistics about them. It takes a stats object so it update that in a concurrent-safe manner for each new measure it receives.

func NewDefaultMonitor 

func NewDefaultMonitor(stats *Stats) *Monitor

NewDefaultMonitor returns a new monitor given the stats

func NewMonitor 

func NewMonitor(port int, stats *Stats) *Monitor

NewMonitor returns a monitor listening on the given port

func (*Monitor) Listen 

func (m *Monitor) Listen() error

Listen will start listening for incoming connections on this address It needs the stats struct pointer to update when measures come Return an error if something went wrong during the connection setup

func (*Monitor) Stop 

func (m *Monitor) Stop()

Stop will close every connections it has And will stop updating the stats

type PercentileFilter 

type PercentileFilter struct {
	// contains filtered or unexported fields
}

PercentileFilter is used to process data before making any statistics about them

func NewPercentileFilter 

func NewPercentileFilter(toFilter map[string]float64) PercentileFilter

NewPercentileFilter returns a percentile filter that will filter all values belonging to keys given in the map, by the specified amount of the percentile.

func (*PercentileFilter) Filter 

func (df *PercentileFilter) Filter(measure string, values []float64) []float64

Filter out a serie of values

type Stats 

type Stats struct {
	sync.Mutex
	// contains filtered or unexported fields
}

Stats holds the different measurements done

func AverageStats 

func AverageStats(stats []*Stats) *Stats

AverageStats will make an average of the given stats

func NewStats 

func NewStats(defs map[string]string, df DataFilter) *Stats

NewStats return a Stats with the given defaults values. For example: { "nodes": "10", "simul": "funny_one" }. If df is nil, no filter is taken.

func (*Stats) Collect 

func (s *Stats) Collect()

Collect make the final computations before stringing or writing. Automatically done in other methods anyway.

func (*Stats) Received 

func (s *Stats) Received() int

Received returns the nmber of updates received for this stats

func (*Stats) String 

func (s *Stats) String() string

Returns an overview of the stats - not complete data returned!

func (*Stats) Update 

func (s *Stats) Update(m *singleMeasure)

Update will update the Stats with this given measure

func (*Stats) Value 

func (s *Stats) Value(name string) *Value

Value returns the value object corresponding to this name in this Stats

func (*Stats) WriteHeader 

func (s *Stats) WriteHeader(w io.Writer)

WriteHeader will write the header to the writer

func (*Stats) WriteIndividualStats 

func (s *Stats) WriteIndividualStats(w io.Writer) error

WriteIndividualStats will write the values to the specified writer but without making averages. Each value should either be:

  • represented once - then it'll be copied to all runs
  • have the same frequency as the other non-once values

func (*Stats) WriteValues 

func (s *Stats) WriteValues(w io.Writer)

WriteValues will write the values to the specified writer

type TimeMeasure 

type TimeMeasure struct {
	Wall *singleMeasure
	CPU  *singleMeasure
	User *singleMeasure
	// contains filtered or unexported fields
}

TimeMeasure represents a measure regarding time: It includes the wallclock time, the cpu time + the user time.

func NewTimeMeasure 

func NewTimeMeasure(name string) *TimeMeasure

NewTimeMeasure return *TimeMeasure

func (*TimeMeasure) Record 

func (tm *TimeMeasure) Record()

Record sends the measurements to the monitor:

- wall time: *name*_wall

- system time: *name*_system

- user time: *name*_user

type Value 

type Value struct {
	sync.Mutex
	// contains filtered or unexported fields
}

Value is used to compute the statistics it represent the time to an action (setup, shamir round, coll round etc) use it to compute streaming mean + dev

func AverageValue 

func AverageValue(st ...*Value) *Value

AverageValue will create a Value averaging all Values given

func NewValue 

func NewValue(name string) *Value

NewValue returns a new value object with this name

func (*Value) Avg 

func (t *Value) Avg() float64

Avg returns the average (mean) of the Values

func (*Value) Collect 

func (t *Value) Collect()

Collect will collect all float64 stored in the store's Value and will compute the basic statistics about them such as min, max, dev and avg.

func (*Value) Dev 

func (t *Value) Dev() float64

Dev returns the standard deviation of the Values

func (*Value) Filter 

func (t *Value) Filter(filt DataFilter)

Filter outs its Values

func (*Value) HeaderFields 

func (t *Value) HeaderFields() []string

HeaderFields returns the first line of the CSV-file

func (*Value) Max 

func (t *Value) Max() float64

Max returns the maximum of all stored float64

func (*Value) Min 

func (t *Value) Min() float64

Min returns the minimum of all stored float64

func (*Value) NumValue 

func (t *Value) NumValue() int

NumValue returns the number of Value added

func (*Value) SingleValues 

func (t *Value) SingleValues(i int) []string

SingleValues returns the string representation of an entry in the value

func (*Value) Store 

func (t *Value) Store(newTime float64)

Store takes this new time and stores it for later analysis Since we might want to do percentile sorting, we need to have all the Values For the moment, we do a simple store of the Value, but note that some streaming percentile algorithm exists in case the number of messages is growing to big.

func (*Value) String 

func (t *Value) String() string

func (*Value) Sum 

func (t *Value) Sum() float64

Sum returns the sum of all stored float64

func (*Value) Values 

func (t *Value) Values() []string

Values returns the string representation of a Value

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.