Clymene
The Clymene is a time series data collection platform for distributed systems inspired
by Prometheus
and Jaeger. Time series data from various environments can be collected and stored in
different types of databases. It can be configured in a variety of architectures. Also, Clymene Agent's time series data collection uses fewer resources than Prometheus' remote_write.
Various time series data analysis functions will be added.
Architecture
Use only agent
Agent can store time series data in a variety of DBs and support Composite Writers that can be stored in multiple DBs at
once.
Including kafka and ingester
Ingester consumes time series data loaded on kafka, can store time series data in various DBs, and supports Composite
Writers that can be stored in multiple DBs at once.
Use gateway
Gateway collects time series data through gRPC communication, stores time series data in various DBs, and supports
Composite Writers that can be stored in multiple DBs at once.
components
dockerhub : bourbonkk/clymene-agent:v1.x.x
redhatQuay: quay.io/clymene/clymene-agent:v1.x.x
The Clymene-agent is service that collects time series data(does not use disks)
- Service Discovery
- scrape time series data
- Time-series data transfer to gateway(gRPC) (Optional)
- Time-series data transfer to kafka (Optional)
- Time-series data insert to Database(supported DB) (Optional)
dockerhub : bourbonkk/clymene-ingester:v1.x.x
redhatQuay: quay.io/clymene/clymene-ingester:v1.x.x
The Clymene ingester is an optional service responsible for insert time series data loaded on kafka into the database.
- Kafka message consume
- Time-series data insert to Database(supported DB) (Optional)
dockerhub : bourbonkk/clymene-gateway:v1.x.x
redhatQuay: quay.io/clymene/clymene-gateway:v1.x.x
The Clymene Gateway is an optional service that can receive metric data from the another component through gRPC
communication.
- gRPC Service
- Time-series data insert to Database(supported DB) (Optional)
How to work it on k8s
For example, see
the clymene_using_gateway.yaml
How to work it on docker-compose
For example, see
the docker-compose-clymene_using_gateway.yml
Roadmap
- Various DB support(ElasticSearch, Prometheus, Cortex, OpenTSDB, influxdb, TDengine, kdb)
- AI/ML platform for clymene(https://github.com/Clymene-project/clymene-analyzer)
Get in Touch
Have questions, suggestions, bug reports? Reach the project community via these channels:
Further reading
To learn more about Clymene, consult the following talks and articles.
Recent talks and articles
License
Apache License 2.0, see LICENSE.
Code Style