pulse

README

Pulse

Pulse is a stat collecting and publishing service. It serves historical stats over an http api while live stats are sent to mist for live updates.

Usage

Simply running pulse -s will start pulse with the default config options.
pulse -h or pulse --help will show more detailed usage and config options:

Usage:
  pulse [flags]

Flags:
  -a, --aggregate-interval int         Interval at which stats are aggregated (default 15)
  -b, --beat-interval int              Heartbeat frequency (seconds) (default 30)
  -c, --config-file string             Config file location for server
  -C, --cors-allow string              Sets the 'Access-Control-Allow-Origin' header (default "*")
  -H, --http-listen-address string     Http listen address (default "127.0.0.1:8080")
  -i, --influx-address string          InfluxDB server address (default "http://127.0.0.1:8086")
  -I, --insecure                       Run insecure (default true)
  -k, --kapacitor-address string       Kapacitor server address (http://127.0.0.1:9092)
  -l, --log-level string               Level at which to log (default "INFO")
  -m, --mist-address string            Mist server address
  -M, --mist-token string              Mist server token
  -p, --poll-interval int              Interval to request stats from clients (default 60)
  -r, --retention int                  Number of weeks to store aggregated stats (default 1)
  -s, --server                         Run as server
  -S, --server-listen-address string   Server listen address (default "127.0.0.1:3000")
  -t, --token string                   Security token (recommend placing in config file) (default "secret")
  -v, --version                        Print version info and exit

Config File Options:

{
  "server": true,
  "server-listen-address": "127.0.0.1:3000",
  "http-listen-address": "127.0.0.1:8080",
  "influx-address": "http://127.0.0.1:8086",
  "kapacitor-address": "http://127.0.0.1:9092",
  "insecure": true,
  "mist-address": "",
  "mist-token": "",
  "log-level": "info",
  "cors-allow": "*",
  "token": "secret",
  "poll-interval": 60,
  "aggregate-interval": 15,
  "beat-interval": 30,
  "retention": 12
}

API

Route	Description	Output
GET /keys	Returns list of stats being recorded	string array
GET /tags	Returns list of filterable tags	string array
GET /latest/{stat}*	Returns latest stat (averages if multiple filters applied)	json stat object
GET /hourly/{stat}**	Returns hourly averages for stat	json array of stat objects
GET /daily/{stat}**	Returns average for stat at the same daily time	string map

ALERTS (requires "kapacitor-address" to be configured)

Route	Description	Payload	Output
POST /alerts	Add a kapacitor alert	json alert object	json alert object
PUT /alerts	Update a kapacitor alert	json alert object	json alert object
DELETE /alerts/{alert}	Delete a kapacitor alert	nil	success message

*: reserved query parameters is 'verb', all others act as filters
**: reserved query parameters are 'backfill', 'verb', 'start', and 'stop', all others act as filters

note: The API requires a token to be passed for authentication by default and is configurable at server start (--token). The token is passed in as a custom header: X-AUTH-TOKEN.

For examples, see the api's readme.

Data Types

Stat Object

json:

{
  "time": 1465419600,
  "value": 0.75
}

Fields:

• time: Unix epoch timestamp of stat
• value: Numeric value of stat

Alert Object

json:

{
  "tags": {"host":"abc"},
  "metric": "cpu_used",
  "level": "crit",
  "threshold": 80,
  "duration": "30s",
  "post": "http://127.0.0.1/alert"
}

Fields:

• tags: Populates the WHERE
• metric: Stat to track
• level: Alert level (info, warn, crit)
• threshold: Limit that alert is triggered at
• duration: How far back to average (5m)
• post: Api to hit when alert is triggered

Relay

A pulse relay is a service that connects to pulse and advertises stats that are available for collection. A relay implementation is available in the pulse project and can be embedded in other projects.

For an example, look in the README for relay.

TCP pulse api

The TCP api used to communicate between the pulse server and a relay is simple and is designed to be human readable and debuggable. It is newline delimited.

Command	Description	Response
id {id}	Must be the first command to be run, identifies the client to the server	ok
add {name}	Exposes a stat that can be collected by the server	ok
remove {name}	Removes a stat previously exposed to the server	ok

TCP relay api

Command	Description	Response
get {tag,tag2}	Request a list of stats corrosponding to the list of tags passed in	got {tag:value}
flush	Clear all current values from the stat collectors	ok
override {duration} {tag:interval}	for duration seconds, bump the collection interval from the default to interval for each tag:interval	ok

Notes

• If an override is specified for a stat, and a new machine comes online and connects, that override is NOT honored.
• Pulse server does not actively connect to servers to have stats pushed to it, rather, it waits for stat collecting machines to connect and then requests certain stats on specific intervals.

Contributing

Contributions to the pulse project are welcome and encouraged. Pulse is a Nanobox project and contributions should follow the Nanobox Contribution Process & Guidelines.

TODO

Licence

Mozilla Public License Version 2.0

Documentation

Overview

Pulse is a stat collecting and publishing service. It serves historical stats over an http api while live stats are sent to mist for live updates.

Usage

To start pulse as a server, simply run (with influx running locally):

pulse -s

For more specific usage information, refer to the help doc `pulse -h`:

Usage:
  pulse [flags]

Flags:
  -a, --aggregate-interval int         Interval at which stats are aggregated (default 15)
  -c, --config-file string              Config file location for server
  -C, --cors-allow string              Sets the 'Access-Control-Allow-Origin' header (default "*")
  -H, --http-listen-address string     Http listen address (default "127.0.0.1:8080")
  -i, --influx-address string          InfluxDB server address (default "http://127.0.0.1:8086")
  -I, --insecure                       Run insecure (default true)
  -k, --kapacitor-address string       Kapacitor server address (http://127.0.0.1:9092)
  -l, --log-level string               Level at which to log (default "INFO")
  -m, --mist-address string            Mist server address
  -M, --mist-token string              Mist server token
  -p, --poll-interval int              Interval to request stats from clients (default 60)
  -s, --server                         Run as server
  -S, --server-listen-address string   Server listen address (default "127.0.0.1:3000")
  -t, --token string                   Security token (recommend placing in config file) (default "secret")
  -v, --version                        Print version info and exit