processor

Documentation

Overview

Package processor is the smallest processor entity for which the watermark will strictly monotonically increase.

Index

• type ProcessorEntitier
  • func NewProcessorEntity(name string) ProcessorEntitier
• type Watermark
  • func (w Watermark) After(t time.Time) bool
  • func (w Watermark) Before(t time.Time) bool
  • func (w Watermark) String() string
  • func (w Watermark) UnixMilli() int64

Examples

• Watermark.String

Types

type ProcessorEntitier

type ProcessorEntitier interface {
	GetName() string
}

ProcessorEntitier defines what can be a processor. The Processor is the smallest unit where the watermark will monotonically increase.

func NewProcessorEntity

func NewProcessorEntity(name string) ProcessorEntitier

NewProcessorEntity returns a new `ProcessorEntitier`.

type Watermark

type Watermark time.Time

Watermark is the monotonically increasing watermark. It is tightly coupled with ProcessorEntitier as the processor is responsible for monotonically increasing Watermark for that processor. NOTE: today we support only second progression of watermark, we need to support millisecond too.

func (Watermark) After

func (w Watermark) After(t time.Time) bool

func (Watermark) Before

func (w Watermark) Before(t time.Time) bool

func (Watermark) String

func (w Watermark) String() string

Example

location, _ := time.LoadLocation("UTC")
wm := Watermark(time.Unix(1651129200, 0).In(location))
fmt.Println(wm)

Output:

2022-04-28T07:00:00Z

func (Watermark) UnixMilli

func (w Watermark) UnixMilli() int64