Version: v0.0.0-...-bc3f6f8 Latest Latest

This package is not in the latest version of its module.

Go to latest
Published: Sep 10, 2019 License: Apache-2.0 Imports: 15 Imported by: 0



Package monitor package handle the logging, collection and computation of statistical data. Every application can send some Measure (for the moment, we mostly measure the CPU time but it can be applied later for any kind of measures). The Monitor receives them and updates a Stats struct. This Stats struct can hold many different kinds of Measurements (the measure of a specific action such as "round time" or "verify time" etc). These measurements contain Values which compute the actual min/max/dev/avg values.

The Proxy allows to relay Measure from clients to the listening Monitor. A starter feature is also the DataFilter which can apply some filtering rules to the data before making any statistics about them.



View Source
const DefaultSinkPort = 10000

DefaultSinkPort is the default port where a monitor will listen and a proxy will contact the monitor.

View Source
const Sink = ""

Sink is the address where to listen for the monitor. The endpoint can be a monitor.Proxy or a direct connection with measure.go


This section is empty.


func ConnectSink

func ConnectSink(addr string) error

ConnectSink connects to the given endpoint and initialises a json encoder. It can be the address of a proxy or a monitoring process. Returns an error if it could not connect to the endpoint.

func EndAndCleanup

func EndAndCleanup()

EndAndCleanup sends a message to end the logging and closes the connection

func RecordSingleMeasure

func RecordSingleMeasure(name string, value float64)

RecordSingleMeasure sends the pair name - value to the monitor directly.


type Counter

type Counter interface {
	Values() map[string]float64

Counter is an interface that can be used to report multiple values that keeps evolving. The keys in the returned map is the name of the value to record.

type CounterMeasure

type CounterMeasure struct {
	// contains filtered or unexported fields

CounterMeasure is a struct that takes a Counter and can send the measurements to the monitor. Each time Record() is called, the measurements are put back to 0 (while the Counter still sends increased bytes number).

func NewCounterMeasure

func NewCounterMeasure(name string, counter Counter) *CounterMeasure

NewCounterMeasure returns an CounterMeasure fresh. The base value are set to the values returned by counter.Values().

func (*CounterMeasure) Record

func (cm *CounterMeasure) Record()

Record send the actual number of bytes read and written (**name**_written & **name**_read) and reset the counters.

type DataFilter

type DataFilter interface {
	Filter(measure string, values []float64) []float64

DataFilter is a generic interface that can filter data according to some rules. For example, filter out everything outside the 90-th percentile.

type Measure

type Measure interface {
	// Record must be called when you want to send the value
	// over the monitor listening.
	// Implementation of this interface must RESET the value to `0` at the end
	// of Record(). `0` means the initial value / meaning this measure had when
	// created.
	// Example: TimeMeasure.Record() will reset the time to `time.Now()`
	//          CounterMeasure.Record() will  reset the counter of the bytes
	//          read / written to 0.
	//          etc

Measure is an interface for measurements Usage:

measure := monitor.SingleMeasure("bandwidth")


measure := monitor.NewTimeMeasure("round")

type Monitor

type Monitor struct {
	// contains filtered or unexported fields

Monitor struct is used to collect measures and make the statistics about them. It takes a stats object so it update that in a concurrent-safe manner for each new measure it receives.

func NewDefaultMonitor

func NewDefaultMonitor(stats *Stats) *Monitor

NewDefaultMonitor returns a new monitor given the stats

func NewMonitor

func NewMonitor(port int, stats *Stats) *Monitor

NewMonitor returns a monitor listening on the given port

func (*Monitor) Listen

func (m *Monitor) Listen() error

Listen will start listening for incoming connections on this address It needs the stats struct pointer to update when measures come Return an error if something went wrong during the connection setup

func (*Monitor) Stop

func (m *Monitor) Stop()

Stop will close every connections it has And will stop updating the stats

type PercentileFilter

type PercentileFilter struct {
	// contains filtered or unexported fields

PercentileFilter is used to process data before making any statistics about them

func NewPercentileFilter

func NewPercentileFilter(toFilter map[string]float64) PercentileFilter

NewPercentileFilter returns a percentile filter that will filter all values belonging to keys given in the map, by the specified amount of the percentile.

func (*PercentileFilter) Filter

func (df *PercentileFilter) Filter(measure string, values []float64) []float64

Filter out a serie of values

type Stats

type Stats struct {
	// contains filtered or unexported fields

Stats holds the different measurements done

func AverageStats

func AverageStats(stats []*Stats) *Stats

AverageStats will make an average of the given stats

func NewStats

func NewStats(defs map[string]string, df DataFilter) *Stats

NewStats return a Stats with the given defaults values. For example: { "nodes": "10", "simul": "funny_one" }. If df is nil, no filter is taken.

func (*Stats) Collect

func (s *Stats) Collect()

Collect make the final computations before stringing or writing. Automatically done in other methods anyway.

func (*Stats) Received

func (s *Stats) Received() int

Received returns the nmber of updates received for this stats

func (*Stats) String

func (s *Stats) String() string

Returns an overview of the stats - not complete data returned!

func (*Stats) Update

func (s *Stats) Update(m *singleMeasure)

Update will update the Stats with this given measure

func (*Stats) Value

func (s *Stats) Value(name string) *Value

Value returns the value object corresponding to this name in this Stats

func (*Stats) WriteHeader

func (s *Stats) WriteHeader(w io.Writer)

WriteHeader will write the header to the writer

func (*Stats) WriteIndividualStats

func (s *Stats) WriteIndividualStats(w io.Writer) error

WriteIndividualStats will write the values to the specified writer but without making averages. Each value should either be:

  • represented once - then it'll be copied to all runs
  • have the same frequency as the other non-once values

func (*Stats) WriteValues

func (s *Stats) WriteValues(w io.Writer)

WriteValues will write the values to the specified writer

type TimeMeasure

type TimeMeasure struct {
	Wall *singleMeasure
	CPU  *singleMeasure
	User *singleMeasure
	// contains filtered or unexported fields

TimeMeasure represents a measure regarding time: It includes the wallclock time, the cpu time + the user time.

func NewTimeMeasure

func NewTimeMeasure(name string) *TimeMeasure

NewTimeMeasure return *TimeMeasure

func (*TimeMeasure) Record

func (tm *TimeMeasure) Record()

Record sends the measurements to the monitor:

- wall time: *name*_wall

- system time: *name*_system

- user time: *name*_user

type Value

type Value struct {
	// contains filtered or unexported fields

Value is used to compute the statistics it represent the time to an action (setup, shamir round, coll round etc) use it to compute streaming mean + dev

func AverageValue

func AverageValue(st ...*Value) *Value

AverageValue will create a Value averaging all Values given

func NewValue

func NewValue(name string) *Value

NewValue returns a new value object with this name

func (*Value) Avg

func (t *Value) Avg() float64

Avg returns the average (mean) of the Values

func (*Value) Collect

func (t *Value) Collect()

Collect will collect all float64 stored in the store's Value and will compute the basic statistics about them such as min, max, dev and avg.

func (*Value) Dev

func (t *Value) Dev() float64

Dev returns the standard deviation of the Values

func (*Value) Filter

func (t *Value) Filter(filt DataFilter)

Filter outs its Values

func (*Value) HeaderFields

func (t *Value) HeaderFields() []string

HeaderFields returns the first line of the CSV-file

func (*Value) Max

func (t *Value) Max() float64

Max returns the maximum of all stored float64

func (*Value) Min

func (t *Value) Min() float64

Min returns the minimum of all stored float64

func (*Value) NumValue

func (t *Value) NumValue() int

NumValue returns the number of Value added

func (*Value) SingleValues

func (t *Value) SingleValues(i int) []string

SingleValues returns the string representation of an entry in the value

func (*Value) Store

func (t *Value) Store(newTime float64)

Store takes this new time and stores it for later analysis Since we might want to do percentile sorting, we need to have all the Values For the moment, we do a simple store of the Value, but note that some streaming percentile algorithm exists in case the number of messages is growing to big.

func (*Value) String

func (t *Value) String() string

func (*Value) Sum

func (t *Value) Sum() float64

Sum returns the sum of all stored float64

func (*Value) Values

func (t *Value) Values() []string

Values returns the string representation of a Value

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL