slicedwriter

Documentation

Index

• type Writer
  • func New(cfg config.Config, totalInputSize datasize.ByteSize, outPath string) (*Writer, error)
  • func (w *Writer) AlLBytes() datasize.ByteSize
  • func (w *Writer) AllRows() uint64
  • func (w *Writer) Close() error
  • func (w *Writer) GzipEnabled() bool
  • func (w *Writer) IsSpaceForNextRowInSlice(rowLength uint64) bool
  • func (w *Writer) Slices() uint32
  • func (w *Writer) Write(row []byte) error

Types

type Writer

type Writer struct {
	// contains filtered or unexported fields
}

Writer writes CSV to a sliced table directory. Each part is one file in the directory. When maxRows/maxBytes is reached -> a new file/slice is created.

func New

func New(cfg config.Config, totalInputSize datasize.ByteSize, outPath string) (*Writer, error)

func (*Writer) AlLBytes

func (w *Writer) AlLBytes() datasize.ByteSize

func (*Writer) AllRows

func (w *Writer) AllRows() uint64

func (*Writer) Close

func (w *Writer) Close() error

func (*Writer) GzipEnabled

func (w *Writer) GzipEnabled() bool

func (*Writer) IsSpaceForNextRowInSlice

func (w *Writer) IsSpaceForNextRowInSlice(rowLength uint64) bool

func (*Writer) Slices

func (w *Writer) Slices() uint32

func (*Writer) Write

func (w *Writer) Write(row []byte) error