crankshaftd

README

crankshaftd

Simple Go agent to ingest streaming data from Turbine via SSE and push it into StatsD as a gauge or to InfluxDB as a series.

Property Munging

All keys related to properties (such as max threadpool size, queue lengths, etc.) are stripped by default.

Properties of the following patterns are kept:

• current*
• rollingCount*
• latencyTotal_*
• isCircuitBreakerOpen

Normal keys are pushed under my-prefix.my-cluster.MyCommandImpl.rollingCountSuccess

Latency histograms are pushed under my-prefix.my-cluster.MyCommandImpl.latencyTotal.xx_pct

isCircuitBreakerOpen will be either 0 or 1.

Additionally, all numeric metrics are divided by the number of reporting hosts. This is because Turbine simply sums all metrics, including percentiles.

StatsD caveat

All metric values are cast from float64 -> int64.

Running

Create a config.toml with your config

# Turbine connection information
host = "turbine.yourcompany.com"
port = 80
tls_enabled = false
clusters = ["cluster1", "cluster2"]

# Backend to stream updates to, 'influxdb' or 'statsd'
backendtype = "influxdb"

[statsd]
host = "127.0.0.1"
port = 8125
prefix = "hystrix"

Build the project

go build

And deploy the resulting binary & config

./crankshaftd

Or run with a different config

./crankshaftd dev.toml

License

Copyright 2016 Michael Rose

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this work except in compliance with the License. You may obtain a copy of the License in the LICENSE file, or at:

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.