kafka

Documentation

Index

• func IsTopicExist(err error) bool
• func NewLeastBytesPartitioner(topic string) sarama.Partitioner
• type Consumer
  • func NewConsumer(cc conf.ConnectorConfig, dialTimeout time.Duration) (Consumer, error)
• type Manager
  • func NewManager(cc conf.ConnectorConfig, bc conf.NATSKafkaBridgeConfig) (Manager, error)
• type Message
• type Producer
  • func NewErroredProducer(err error) Producer
  • func NewProducer(cc conf.ConnectorConfig, bc conf.NATSKafkaBridgeConfig, topic string) (Producer, error)

Functions

func IsTopicExist

func IsTopicExist(err error) bool

IsTopicExist returns whether an error is caused by a topic already existing.

func NewLeastBytesPartitioner

func NewLeastBytesPartitioner(topic string) sarama.Partitioner

NewLeastBytesPartitioner function takes topic as an argument, but it is not used. This has been done as it implements the sarama.PartitionerConstructor interface which requires it.

Types

type Consumer

type Consumer interface {
	Fetch(context.Context) (Message, error)
	Commit(context.Context, Message) error
	GroupMode() bool
	Close() error
}

Consumer represents a Kafka Consumer.

func NewConsumer

func NewConsumer(cc conf.ConnectorConfig, dialTimeout time.Duration) (Consumer, error)

NewConsumer returns a new Kafka Consumer.

type Manager

type Manager interface {
	CreateTopic(topic string, partitions, replication int) error
	Close() error
}

Manager represents an object that can manage Kafka Producers and Consumers.

func NewManager

func NewManager(cc conf.ConnectorConfig, bc conf.NATSKafkaBridgeConfig) (Manager, error)

NewManager returns a Kafka Manager.

type Message

type Message struct {
	Topic     string
	Partition int
	Offset    int64

	Key   []byte
	Value []byte
}

Message represents a Kafka message.

type Producer

type Producer interface {
	Write(Message) error
	Close() error
}

Producer represents a Kafka producer.

func NewErroredProducer

func NewErroredProducer(err error) Producer

NewErroredProducer returns a Producer that fails when any methods are called.

func NewProducer

func NewProducer(cc conf.ConnectorConfig, bc conf.NATSKafkaBridgeConfig, topic string) (Producer, error)

NewProducer returns a new Kafka Producer.