README
¶
bufstream-demo
Bufstream is a fully self-hosted drop-in replacement for Apache Kafka® that writes data to S3-compatible object storage. It’s 100% compatible with the Kafka protocol, including support for exactly-once semantics (EOS) and transactions. Bufstream is 8x cheaper to operate, and a single cluster can elastically scale to hundreds of GB/s of throughput. It's the universal Kafka replacement for the modern age.
Additionally, for teams sending Protobuf messages across their Kafka topics, Bufstream is a perfect partner. Bufstream can enforce data quality and governance requirements on the broker with Protovalidate. Bufstream can directly persist records as Apache Iceberg™ tables, reducing time-to-insight in popular data lakehouse products such as Snowflake or ClickHouse.
This repository contains code used in Bufstream's quickstart. Head over to the quickstart to walk through this repository and get started!
Curious to see more?
To learn more about Bufstream, check out the launch blog post, dig into the benchmark and cost analysis, or join us in the Buf Slack!
Directories
¶
| Path | Synopsis |
|---|---|
|
cmd
|
|
|
bufstream-demo-consume
command
Package main implements the consumer of the demo.
|
Package main implements the consumer of the demo. |
|
bufstream-demo-produce
command
This is run as part of docker compose.
|
This is run as part of docker compose. |
|
gen
|
|
|
pkg
|
|
|
app
Package app implements boilerplate code shared by the producer and consumer.
|
Package app implements boilerplate code shared by the producer and consumer. |
|
consume
Package consume implements a toy consumer.
|
Package consume implements a toy consumer. |
|
csr
Package csr implements helper functionality around the Confluent Schema Registry.
|
Package csr implements helper functionality around the Confluent Schema Registry. |
|
produce
Package produce implements a toy producer.
|
Package produce implements a toy producer. |