s3sqs

Documentation

Index

• type Downloader
• type Ingress
  • func New(conf *config.S3SQS, region string, monitor monitor.Monitor) (*Ingress, error)
  • func NewWith(reader Reader, loader Downloader, monitor monitor.Monitor) *Ingress
  • func (s *Ingress) Close()
  • func (s *Ingress) Range(f func(v []byte) bool)
• type Reader

Types

type Downloader

type Downloader interface {
	Load(ctx context.Context, uri string) ([]byte, error)
}

Downloader represents an object downloader

type Ingress

type Ingress struct {
	// contains filtered or unexported fields
}

Ingress represents an ingress layer.

func New

func New(conf *config.S3SQS, region string, monitor monitor.Monitor) (*Ingress, error)

New creates a new ingestion with SQS/S3 files.

func NewWith

func NewWith(reader Reader, loader Downloader, monitor monitor.Monitor) *Ingress

NewWith creates a new ingestion with SQS/S3 files.

func (*Ingress) Close

func (s *Ingress) Close()

Close stops consuming

func (*Ingress) Range

func (s *Ingress) Range(f func(v []byte) bool)

Range iterates through the queue, stops only if Close() is called or the f callback returns true.

type Reader

type Reader interface {
	io.Closer
	StartPolling(maxPerRead, sleepMs int64, attributeNames, messageAttributeNames []*string) <-chan *awssqs.Message
	DeleteMessage(msg *awssqs.Message) error
}

Reader represents a consumer for SQS