inputreader

Documentation

Index

• type FileWatcherReader
  • func NewFileWatcherReader(f string, j bool, daily bool, logger *log.Logger) (*FileWatcherReader, error)
  • func (fw *FileWatcherReader) Read(p []byte) (n int, err error)
  • func (rl *FileWatcherReader) Teardown()
• type RedisLPOPReader
  • func NewLPOPReader(rc *redis.Conn, db int, queue string) (*RedisLPOPReader, error)
  • func (rl *RedisLPOPReader) Read(p []byte) (n int, err error)
  • func (rl *RedisLPOPReader) Teardown()

Types

type FileWatcherReader

type FileWatcherReader struct {
	// contains filtered or unexported fields
}

FileWatcherReader is an abstraction of a folder watcher and behaves like a reader

func NewFileWatcherReader

func NewFileWatcherReader(f string, j bool, daily bool, logger *log.Logger) (*FileWatcherReader, error)

NewFileWatcherReader creates a new FileWatcherReader json specifies whether we now we handle json files

func (*FileWatcherReader) Read

func (fw *FileWatcherReader) Read(p []byte) (n int, err error)

Read waits for InCloseWrite file event uses a bytes reader to copy the resulting file encoded in b64 in p

func (*FileWatcherReader) Teardown

func (rl *FileWatcherReader) Teardown()

Teardown is called on error to stop the Reading loop if needed

type RedisLPOPReader

type RedisLPOPReader struct {
	// contains filtered or unexported fields
}

RedisLPOPReader is a abstraction of LPOP list and behaves like a reader

func NewLPOPReader

func NewLPOPReader(rc *redis.Conn, db int, queue string) (*RedisLPOPReader, error)

NewLPOPReader creates a new RedisLPOPReader

func (*RedisLPOPReader) Read

func (rl *RedisLPOPReader) Read(p []byte) (n int, err error)

Read LPOP the redis queue and use a bytes reader to copy the resulting data in p

func (*RedisLPOPReader) Teardown

func (rl *RedisLPOPReader) Teardown()

Teardown is called on error to close the redis connection