Kafka topic management tools
Read the blog post: Introducing Kafka-Kit: Tools for Scaling Kafka
This repository contains several services and tools for that help better operate Kafka. See the README for each tool for further details.
Topicmappr replaces and extends the
kafka-reassign-partition tool bundled with Kafka. It allows for minimal movement broker replacements, cluster storage rebalancing / partition bin-packing, leadership optimization, many-at-once topic management, and more—all with rack awareness support.
A gRPC+HTTP API service for Kafka that allows granular resource (topics, brokers) lookup and management with custom tagging support.
A service that automatically paces Kafka replication/recovery throttle rates, powered with metrics using the Datadog API.
A utility that fetches metrics via the Datadog API for Kafka storage rebalancing and partition mapping with topicmappr.
See the Development Guide for testing and contributing changes.
Package kafkaadmin provides Kafka administrative functionality.
|Package kafkaadmin provides Kafka administrative functionality.|
Package kafkametrics fetches Kafka broker metrics and posts events to supported metrics backends.
|Package kafkametrics fetches Kafka broker metrics and posts events to supported metrics backends.|
Package datadog implements a kafkametrics Handler.
|Package datadog implements a kafkametrics Handler.|
Package registry is a reverse proxy.
|Package registry is a reverse proxy.|