Documentation
¶
Overview ¶
Package writers provides implementations of dataset writers for various data formats.
Index ¶
- Variables
- func NewArrowWriter(config core.WriterConfig) (core.DatasetWriter, error)
- func NewJSONWriter(config core.WriterConfig) (core.DatasetWriter, error)
- func NewParquetWriter(config core.WriterConfig) (core.DatasetWriter, error)
- type ArrowWriter
- type Creator
- type Factory
- type JSONWriter
- type ParquetWriter
Constants ¶
This section is empty.
Variables ¶
var DefaultFactory = NewFactory()
DefaultFactory is the default writer factory with built-in writer types.
Functions ¶
func NewArrowWriter ¶
func NewArrowWriter(config core.WriterConfig) (core.DatasetWriter, error)
NewArrowWriter creates a new Arrow IPC writer.
func NewJSONWriter ¶
func NewJSONWriter(config core.WriterConfig) (core.DatasetWriter, error)
NewJSONWriter creates a new JSON writer.
func NewParquetWriter ¶
func NewParquetWriter(config core.WriterConfig) (core.DatasetWriter, error)
NewParquetWriter creates a new Parquet writer.
Types ¶
type ArrowWriter ¶
type ArrowWriter struct {
// contains filtered or unexported fields
}
ArrowWriter implements a writer for Arrow IPC files.
func (*ArrowWriter) Close ¶
func (w *ArrowWriter) Close() error
Close closes the writer and flushes any pending data.
type Creator ¶
type Creator func(config core.WriterConfig) (core.DatasetWriter, error)
Creator is a function that creates a writer from a configuration.
type Factory ¶
type Factory struct {
// contains filtered or unexported fields
}
Factory creates a writer based on the given configuration.
func (*Factory) Create ¶
func (f *Factory) Create(config core.WriterConfig) (core.DatasetWriter, error)
Create creates a writer based on the given configuration.
type JSONWriter ¶
type JSONWriter struct {
// contains filtered or unexported fields
}
JSONWriter implements a writer for JSON files.
func (*JSONWriter) Close ¶
func (w *JSONWriter) Close() error
Close closes the writer and flushes any pending data.
type ParquetWriter ¶
type ParquetWriter struct {
// contains filtered or unexported fields
}
ParquetWriter implements a writer for Parquet files.
func (*ParquetWriter) Close ¶
func (w *ParquetWriter) Close() error
Close closes the writer and flushes any pending data.
Source Files