encoding

package
v0.0.0-...-1ed3a2a Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Dec 4, 2020 License: Apache-2.0, Apache-2.0 Imports: 6 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func DeltaByteArrayEncode

func DeltaByteArrayEncode(bytesSlices [][]byte) (data []byte)

DeltaByteArrayEncode encodes sequence of strings values specified in https://github.com/apache/parquet-format/blob/master/Encodings.md#delta-strings-delta_byte_array--7

Supported Types: BYTE_ARRAY

func DeltaEncode

func DeltaEncode(values interface{}, parquetType parquet.Type) []byte

DeltaEncode encodes values specified in https://github.com/apache/parquet-format/blob/master/Encodings.md#delta-encoding-delta_binary_packed--5

Supported Types: INT32, INT64.

func DeltaLengthByteArrayEncode

func DeltaLengthByteArrayEncode(bytesSlices [][]byte) (data []byte)

DeltaLengthByteArrayEncode encodes bytes slices specified in https://github.com/apache/parquet-format/blob/master/Encodings.md#delta-length-byte-array-delta_length_byte_array--6

Supported Types: BYTE_ARRAY

func PlainEncode

func PlainEncode(values interface{}, parquetType parquet.Type) []byte

PlainEncode encodes values specified in https://github.com/apache/parquet-format/blob/master/Encodings.md#plain-plain--0

Supported Types: BOOLEAN, INT32, INT64, FLOAT, DOUBLE, BYTE_ARRAY

func RLEBitPackedHybridEncode

func RLEBitPackedHybridEncode(values interface{}, bitWidth int32, parquetType parquet.Type) []byte

RLEBitPackedHybridEncode encodes values specified in https://github.com/apache/parquet-format/blob/master/Encodings.md#run-length-encoding--bit-packing-hybrid-rle--3

Supported Types: INT32, INT64

func RLEDictEncode

func RLEDictEncode(values []interface{}, parquetType parquet.Type, bitWidth int32) (dictPageData, dataPageData []byte, dictValueCount int32, indexBitWidth uint8)

RLEDictEncode encodes values specified in https://github.com/apache/parquet-format/blob/master/Encodings.md#dictionary-encoding-plain_dictionary--2-and-rle_dictionary--8 and returns dictionary page data and data page data.

Dictionary page data contains PLAIN encodeed slice of uniquely fully defined non-nil values. Data page data contains RLE/Bit-Packed Hybrid encoded indices of fully defined non-nil values.

Supported Types: BOOLEAN, INT32, INT64, FLOAT, DOUBLE, BYTE_ARRAY

Types

This section is empty.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL