pubsub

README

Google Pub/Sub sink

This sink implements Google Pub/Sub protocol. It only works for streams, not for compaction like the other sinks. It can can be enabled by adding the following configuration in the tables section:

tables:
  eventlog:
    streams:
      - pubsub:
          project: my-gcp-project
          topic: my-topic
          filter: "gcs://my-bucket/my-function.lua"
          encoder: json
...

Documentation

Index

• type Writer
  • func New(project, topic, encoding, filter string, monitor monitor.Monitor, ...) (*Writer, error)
  • func (w *Writer) Close() error
  • func (w *Writer) Stream(row block.Row) error
  • func (w *Writer) Write(key key.Key, blocks []block.Block) error

Types

type Writer

type Writer struct {
	*base.Writer
	// contains filtered or unexported fields
}

Writer to write and stream to PubSub

func New

func New(project, topic, encoding, filter string, monitor monitor.Monitor, opts ...option.ClientOption) (*Writer, error)

New creates a new writer

func (*Writer) Close

func (w *Writer) Close() error

Close closes the Pub/Sub client

func (*Writer) Stream

func (w *Writer) Stream(row block.Row) error

Stream encodes data and pushes it into buffer

func (*Writer) Write

func (w *Writer) Write(key key.Key, blocks []block.Block) error

Write writes the data to the sink.