kafkabuff

README

kafkabuff

kafkabuff is a thread-safe ring buffer implementation designed for efficient handling of Kafka messages

Features

• Thread-safe operations for adding and retrieving messages.
• Batch retrieval for efficient Kafka message processing.
• Automatic overwriting of the oldest messages when the buffer is full.
• Easy integration with Sarama Kafka client.

Installation

To use kafkabuff, simply run:

go get github.com/vagbundor/kafkabuff

Documentation

Index

• type RingBuffer
  • func NewRingBuffer(size int) *RingBuffer
  • func (rb *RingBuffer) Add(msg *sarama.ProducerMessage)
  • func (rb *RingBuffer) GetBatch(batchSize int) []*sarama.ProducerMessage
  • func (rb *RingBuffer) Size() int

Types

type RingBuffer

type RingBuffer struct {
	// contains filtered or unexported fields
}

RingBuffer is a thread-safe circular buffer for storing Kafka messages

func NewRingBuffer

func NewRingBuffer(size int) *RingBuffer

NewRingBuffer creates a new ring buffer with the specified size.

func (*RingBuffer) Add

func (rb *RingBuffer) Add(msg *sarama.ProducerMessage)

Add inserts a new message into the buffer. If the buffer is full, it overwrites the oldest message.

func (*RingBuffer) GetBatch

func (rb *RingBuffer) GetBatch(batchSize int) []*sarama.ProducerMessage

GetBatch retrieves up to batchSize messages from the ring buffer.

func (*RingBuffer) Size

func (rb *RingBuffer) Size() int

Size returns the current number of messages in the buffer.