array

package
v17.0.0-...-68eeef5 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 23, 2024 License: Apache-2.0, BSD-2-Clause, BSD-3-Clause, + 7 more Imports: 27 Imported by: 0

Documentation

Overview

Package array provides implementations of various Arrow array types.

Index

Examples

Constants

View Source
const (
	// UnknownNullCount specifies the NullN should be calculated from the null bitmap buffer.
	UnknownNullCount = -1

	// NullValueStr represents a null value in arrow.Array.ValueStr and in Builder.AppendValueFromString.
	// It should be returned from the arrow.Array.ValueStr implementations.
	// Using it as the value in Builder.AppendValueFromString should be equivalent to Builder.AppendNull.
	NullValueStr = "(null)"
)

Variables

This section is empty.

Functions

func ApproxEqual

func ApproxEqual(left, right arrow.Array, opts ...EqualOption) bool

ApproxEqual reports whether the two provided arrays are approximately equal. For non-floating point arrays, it is equivalent to Equal.

func ChunkedApproxEqual

func ChunkedApproxEqual(left, right *arrow.Chunked, opts ...EqualOption) bool

ChunkedApproxEqual reports whether two chunked arrays are approximately equal regardless of their chunkings for non-floating point arrays, this is equivalent to ChunkedEqual

func ChunkedEqual

func ChunkedEqual(left, right *arrow.Chunked) bool

ChunkedEqual reports whether two chunked arrays are equal regardless of their chunkings

func ChunkedFromJSON

func ChunkedFromJSON(mem memory.Allocator, dt arrow.DataType, chunkStrs []string, opts ...FromJSONOption) (*arrow.Chunked, error)

func Concatenate

func Concatenate(arrs []arrow.Array, mem memory.Allocator) (result arrow.Array, err error)

Concatenate creates a new arrow.Array which is the concatenation of the passed in arrays. Returns nil if an error is encountered.

The passed in arrays still need to be released manually, and will not be released by this function.

func DictArrayFromJSON

func DictArrayFromJSON(mem memory.Allocator, dt *arrow.DictionaryType, indicesJSON, dictJSON string) (arrow.Array, error)

func Equal

func Equal(left, right arrow.Array) bool

Equal reports whether the two provided arrays are equal.

func FromJSON

func FromJSON(mem memory.Allocator, dt arrow.DataType, r io.Reader, opts ...FromJSONOption) (arr arrow.Array, offset int64, err error)

FromJSON creates an arrow.Array from a corresponding JSON stream and defined data type. If the types in the json do not match the type provided, it will return errors. This is *not* the integration test format and should not be used as such. This intended to be used by consumers more similarly to the current exposing of the csv reader/writer. It also returns the input offset in the reader where it finished decoding since buffering by the decoder could leave the reader's cursor past where the parsing finished if attempting to parse multiple json arrays from one stream.

All the Array types implement json.Marshaller and thus can be written to json using the json.Marshal function

The JSON provided must be formatted in one of two ways:

Default: the top level of the json must be a list which matches the type specified exactly
Example: `[1, 2, 3, 4, 5]` for any integer type or `[[...], null, [], .....]` for a List type
			Struct arrays are represented a list of objects: `[{"foo": 1, "bar": "moo"}, {"foo": 5, "bar": "baz"}]`

Using WithMultipleDocs:
	If the JSON provided is multiple newline separated json documents, then use this option
	and each json document will be treated as a single row of the array. This is most useful for record batches
	and interacting with other processes that use json. For example:
		`{"col1": 1, "col2": "row1", "col3": ...}\n{"col1": 2, "col2": "row2", "col3": ...}\n.....`

Duration values get formated upon marshalling as a string consisting of their numeric value followed by the unit suffix such as "10s" for a value of 10 and unit of Seconds. with "ms" for millisecond, "us" for microsecond, and "ns" for nanosecond as the suffixes. Unmarshalling duration values is more permissive since it first tries to use Go's time.ParseDuration function which means it allows values in the form 3h25m0.3s in addition to the same values which are output.

Interval types are marshalled / unmarshalled as follows:

 MonthInterval is marshalled as an object with the format:
	 { "months": #}
 DayTimeInterval is marshalled using Go's regular marshalling of structs:
	 { "days": #, "milliseconds": # }
 MonthDayNanoInterval values are marshalled the same as DayTime using Go's struct marshalling:
  { "months": #, "days": #, "nanoseconds": # }

Times use a format of HH:MM or HH:MM:SS[.zzz] where the fractions of a second cannot exceed the precision allowed by the time unit, otherwise unmarshalling will error.

Dates use YYYY-MM-DD format

Timestamps use RFC3339Nano format except without a timezone, all of the following are valid:

	YYYY-MM-DD
	YYYY-MM-DD[T]HH
	YYYY-MM-DD[T]HH:MM
 YYYY-MM-DD[T]HH:MM:SS[.zzzzzzzzzz]

The fractions of a second cannot exceed the precision allowed by the timeunit of the datatype.

When processing structs as objects order of keys does not matter, but keys cannot be repeated.

func Hash

func Hash(h *maphash.Hash, data arrow.ArrayData)

func IsTrivialTransposition

func IsTrivialTransposition(transposeMap []int32) bool

func MakeArrayOfNull

func MakeArrayOfNull(mem memory.Allocator, dt arrow.DataType, length int) arrow.Array

MakeArrayOfNull creates an array of size length which is all null of the given data type.

func MakeFromData

func MakeFromData(data arrow.ArrayData) arrow.Array

MakeFromData constructs a strongly-typed array instance from generic Data.

func NewChunkedSlice

func NewChunkedSlice(a *arrow.Chunked, i, j int64) *arrow.Chunked

NewChunkedSlice constructs a zero-copy slice of the chunked array with the indicated indices i and j, corresponding to array[i:j]. The returned chunked array must be Release()'d after use.

NewSlice panics if the slice is outside the valid range of the input array. NewSlice panics if j < i.

func NewColumnSlice

func NewColumnSlice(col *arrow.Column, i, j int64) *arrow.Column

NewColumnSlice returns a new zero-copy slice of the column with the indicated indices i and j, corresponding to the column's array[i:j]. The returned column must be Release()'d after use.

NewColSlice panics if the slice is outside the valid range of the column's array. NewColSlice panics if j < i.

func NewExtensionArrayWithStorage

func NewExtensionArrayWithStorage(dt arrow.ExtensionType, storage arrow.Array) arrow.Array

NewExtensionArrayWithStorage constructs a new ExtensionArray from the provided ExtensionType and uses the provided storage interface as the underlying storage. This will not release the storage array passed in so consumers should call Release on it manually while the new Extension array will share references to the underlying Data buffers.

func NewIntervalData

func NewIntervalData(data arrow.ArrayData) arrow.Array

func NewRecord

func NewRecord(schema *arrow.Schema, cols []arrow.Array, nrows int64) arrow.Record

NewRecord returns a basic, non-lazy in-memory record batch.

NewRecord panics if the columns and schema are inconsistent. NewRecord panics if rows is larger than the height of the columns.

func NewSlice

func NewSlice(arr arrow.Array, i, j int64) arrow.Array

NewSlice constructs a zero-copy slice of the array with the indicated indices i and j, corresponding to array[i:j]. The returned array must be Release()'d after use.

NewSlice panics if the slice is outside the valid range of the input array. NewSlice panics if j < i.

func NewSliceData

func NewSliceData(data arrow.ArrayData, i, j int64) arrow.ArrayData

NewSliceData returns a new slice that shares backing data with the input. The returned Data slice starts at i and extends j-i elements, such as:

slice := data[i:j]

The returned value must be Release'd after use.

NewSliceData panics if the slice is outside the valid range of the input Data. NewSliceData panics if j < i.

func NewTable

func NewTable(schema *arrow.Schema, cols []arrow.Column, rows int64) arrow.Table

NewTable returns a new basic, non-lazy in-memory table. If rows is negative, the number of rows will be inferred from the height of the columns.

NewTable panics if the columns and schema are inconsistent. NewTable panics if rows is larger than the height of the columns.

func NewTableFromRecords

func NewTableFromRecords(schema *arrow.Schema, recs []arrow.Record) arrow.Table

NewTableFromRecords returns a new basic, non-lazy in-memory table.

NewTableFromRecords panics if the records and schema are inconsistent.

func NewTableFromSlice

func NewTableFromSlice(schema *arrow.Schema, data [][]arrow.Array) arrow.Table

NewTableFromSlice is a convenience function to create a table from a slice of slices of arrow.Array.

Like other NewTable functions this can panic if:

  • len(schema.Fields) != len(data)
  • the total length of each column's array slice (ie: number of rows in the column) aren't the same for all columns.

func RangeOfValuesUsed

func RangeOfValuesUsed(input VarLenListLike) (int, int)

Returns the smallest contiguous range of values of the child array that are referenced by all the list values in the input array.

func RecordApproxEqual

func RecordApproxEqual(left, right arrow.Record, opts ...EqualOption) bool

RecordApproxEqual reports whether the two provided records are approximately equal. For non-floating point columns, it is equivalent to RecordEqual.

func RecordEqual

func RecordEqual(left, right arrow.Record) bool

RecordEqual reports whether the two provided records are equal.

func RecordFromJSON

func RecordFromJSON(mem memory.Allocator, schema *arrow.Schema, r io.Reader, opts ...FromJSONOption) (arrow.Record, int64, error)

RecordFromJSON creates a record batch from JSON data. See array.FromJSON for the details of formatting and logic.

A record batch from JSON is equivalent to reading a struct array in from json and then converting it to a record batch.

func RecordFromStructArray

func RecordFromStructArray(in *Struct, schema *arrow.Schema) arrow.Record

RecordFromStructArray is a convenience function for converting a struct array into a record batch without copying the data. If the passed in schema is nil, the fields of the struct will be used to define the record batch. Otherwise the passed in schema will be used to create the record batch. If passed in, the schema must match the fields of the struct column.

func RecordToJSON

func RecordToJSON(rec arrow.Record, w io.Writer) error

RecordToJSON writes out the given record following the format of each row is a single object on a single line of the output.

func SliceApproxEqual

func SliceApproxEqual(left arrow.Array, lbeg, lend int64, right arrow.Array, rbeg, rend int64, opts ...EqualOption) bool

SliceApproxEqual reports whether slices left[lbeg:lend] and right[rbeg:rend] are approximately equal.

func SliceEqual

func SliceEqual(left arrow.Array, lbeg, lend int64, right arrow.Array, rbeg, rend int64) bool

SliceEqual reports whether slices left[lbeg:lend] and right[rbeg:rend] are equal.

func TableApproxEqual

func TableApproxEqual(left, right arrow.Table, opts ...EqualOption) bool

TableEqual returns if the two tables have the approximately equal data in the same schema

func TableEqual

func TableEqual(left, right arrow.Table) bool

TableEqual returns if the two tables have the same data in the same schema

func TableFromJSON

func TableFromJSON(mem memory.Allocator, sc *arrow.Schema, recJSON []string, opt ...FromJSONOption) (arrow.Table, error)

func TransposeDictIndices

func TransposeDictIndices(mem memory.Allocator, data arrow.ArrayData, inType, outType arrow.DataType, dict arrow.ArrayData, transposeMap []int32) (arrow.ArrayData, error)

func UnifyChunkedDicts

func UnifyChunkedDicts(alloc memory.Allocator, chnkd *arrow.Chunked) (*arrow.Chunked, error)

UnifyChunkedDicts takes a chunked array of dictionary type and will unify the dictionary across all of the chunks with the returned chunked array having all chunks share the same dictionary.

The return from this *must* have Release called on it unless an error is returned in which case the *arrow.Chunked will be nil.

If there is 1 or fewer chunks, then nothing is modified and this function will just call Retain on the passed in Chunked array (so Release can safely be called on it). The same is true if the type of the array is not a dictionary or if no changes are needed for all of the chunks to be using the same dictionary.

func UnifyTableDicts

func UnifyTableDicts(alloc memory.Allocator, table arrow.Table) (arrow.Table, error)

UnifyTableDicts performs UnifyChunkedDicts on each column of the table so that any dictionary column will have the dictionaries of its chunks unified.

The returned Table should always be Release'd unless a non-nil error was returned, in which case the table returned will be nil.

Types

type Binary

type Binary struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of variable-length binary strings.

func NewBinaryData

func NewBinaryData(data arrow.ArrayData) *Binary

NewBinaryData constructs a new Binary array from data.

func (*Binary) Data

func (a *Binary) Data() arrow.ArrayData

func (*Binary) DataType

func (a *Binary) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Binary) GetOneForMarshal

func (a *Binary) GetOneForMarshal(i int) interface{}

func (*Binary) IsNull

func (a *Binary) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Binary) IsValid

func (a *Binary) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Binary) Len

func (a *Binary) Len() int

Len returns the number of elements in the array.

func (*Binary) MarshalJSON

func (a *Binary) MarshalJSON() ([]byte, error)

func (*Binary) NullBitmapBytes

func (a *Binary) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Binary) NullN

func (a *Binary) NullN() int

NullN returns the number of null values in the array.

func (*Binary) Offset

func (a *Binary) Offset() int

func (*Binary) Release

func (a *Binary) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Binary) Retain

func (a *Binary) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Binary) String

func (a *Binary) String() string

func (*Binary) Value

func (a *Binary) Value(i int) []byte

Value returns the slice at index i. This value should not be mutated.

func (*Binary) ValueBytes

func (a *Binary) ValueBytes() []byte

func (*Binary) ValueLen

func (a *Binary) ValueLen(i int) int

func (*Binary) ValueOffset

func (a *Binary) ValueOffset(i int) int

func (*Binary) ValueOffset64

func (a *Binary) ValueOffset64(i int) int64

func (*Binary) ValueOffsets

func (a *Binary) ValueOffsets() []int32

func (*Binary) ValueStr

func (a *Binary) ValueStr(i int) string

ValueStr returns a copy of the base64-encoded string value or NullValueStr

func (*Binary) ValueString

func (a *Binary) ValueString(i int) string

ValueString returns the string at index i without performing additional allocations. The string is only valid for the lifetime of the Binary array.

type BinaryBuilder

type BinaryBuilder struct {
	// contains filtered or unexported fields
}

A BinaryBuilder is used to build a Binary array using the Append methods.

func NewBinaryBuilder

func NewBinaryBuilder(mem memory.Allocator, dtype arrow.BinaryDataType) *BinaryBuilder

NewBinaryBuilder can be used for any of the variable length binary types, Binary, LargeBinary, String, LargeString by passing the appropriate data type

func (*BinaryBuilder) Append

func (b *BinaryBuilder) Append(v []byte)

func (*BinaryBuilder) AppendEmptyValue

func (b *BinaryBuilder) AppendEmptyValue()

func (*BinaryBuilder) AppendEmptyValues

func (b *BinaryBuilder) AppendEmptyValues(n int)

func (*BinaryBuilder) AppendNull

func (b *BinaryBuilder) AppendNull()

func (*BinaryBuilder) AppendNulls

func (b *BinaryBuilder) AppendNulls(n int)

func (*BinaryBuilder) AppendString

func (b *BinaryBuilder) AppendString(v string)

func (*BinaryBuilder) AppendStringValues

func (b *BinaryBuilder) AppendStringValues(v []string, valid []bool)

AppendStringValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*BinaryBuilder) AppendValueFromString

func (b *BinaryBuilder) AppendValueFromString(s string) error

func (*BinaryBuilder) AppendValues

func (b *BinaryBuilder) AppendValues(v [][]byte, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*BinaryBuilder) Cap

func (b *BinaryBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*BinaryBuilder) DataCap

func (b *BinaryBuilder) DataCap() int

DataCap returns the total number of bytes that can be stored without allocating additional memory.

func (*BinaryBuilder) DataLen

func (b *BinaryBuilder) DataLen() int

DataLen returns the number of bytes in the data array.

func (*BinaryBuilder) IsNull

func (b *BinaryBuilder) IsNull(i int) bool

func (*BinaryBuilder) Len

func (b *BinaryBuilder) Len() int

Len returns the number of elements in the array builder.

func (*BinaryBuilder) NewArray

func (b *BinaryBuilder) NewArray() arrow.Array

NewArray creates a Binary array from the memory buffers used by the builder and resets the BinaryBuilder so it can be used to build a new array.

Builds the appropriate Binary or LargeBinary array based on the datatype it was initialized with.

func (*BinaryBuilder) NewBinaryArray

func (b *BinaryBuilder) NewBinaryArray() (a *Binary)

NewBinaryArray creates a Binary array from the memory buffers used by the builder and resets the BinaryBuilder so it can be used to build a new array.

func (*BinaryBuilder) NewLargeBinaryArray

func (b *BinaryBuilder) NewLargeBinaryArray() (a *LargeBinary)

func (*BinaryBuilder) NullN

func (b *BinaryBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*BinaryBuilder) Release

func (b *BinaryBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed. Release may be called simultaneously from multiple goroutines.

func (*BinaryBuilder) Reserve

func (b *BinaryBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*BinaryBuilder) ReserveData

func (b *BinaryBuilder) ReserveData(n int)

ReserveData ensures there is enough space for appending n bytes by checking the capacity and resizing the data buffer if necessary.

func (*BinaryBuilder) Resize

func (b *BinaryBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may be reduced.

func (*BinaryBuilder) ResizeData

func (b *BinaryBuilder) ResizeData(n int)

func (*BinaryBuilder) Retain

func (b *BinaryBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*BinaryBuilder) SetNull

func (b *BinaryBuilder) SetNull(i int)

func (*BinaryBuilder) Type

func (b *BinaryBuilder) Type() arrow.DataType

func (*BinaryBuilder) Unmarshal

func (b *BinaryBuilder) Unmarshal(dec *json.Decoder) error

func (*BinaryBuilder) UnmarshalJSON

func (b *BinaryBuilder) UnmarshalJSON(data []byte) error

func (*BinaryBuilder) UnmarshalOne

func (b *BinaryBuilder) UnmarshalOne(dec *json.Decoder) error

func (*BinaryBuilder) UnsafeAppend

func (b *BinaryBuilder) UnsafeAppend(v []byte)

func (*BinaryBuilder) UnsafeAppendBoolToBitmap

func (b *BinaryBuilder) UnsafeAppendBoolToBitmap(isValid bool)

func (*BinaryBuilder) Value

func (b *BinaryBuilder) Value(i int) []byte

type BinaryDictionaryBuilder

type BinaryDictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*BinaryDictionaryBuilder) Append

func (b *BinaryDictionaryBuilder) Append(v []byte) error

func (*BinaryDictionaryBuilder) AppendArray

func (b *BinaryDictionaryBuilder) AppendArray(arr arrow.Array) error

func (*BinaryDictionaryBuilder) AppendEmptyValue

func (b *BinaryDictionaryBuilder) AppendEmptyValue()

func (*BinaryDictionaryBuilder) AppendEmptyValues

func (b *BinaryDictionaryBuilder) AppendEmptyValues(n int)

func (*BinaryDictionaryBuilder) AppendIndices

func (b *BinaryDictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*BinaryDictionaryBuilder) AppendNull

func (b *BinaryDictionaryBuilder) AppendNull()

func (*BinaryDictionaryBuilder) AppendNulls

func (b *BinaryDictionaryBuilder) AppendNulls(n int)

func (*BinaryDictionaryBuilder) AppendString

func (b *BinaryDictionaryBuilder) AppendString(v string) error

func (*BinaryDictionaryBuilder) AppendValueFromString

func (b *BinaryDictionaryBuilder) AppendValueFromString(s string) error

func (*BinaryDictionaryBuilder) Cap

func (b *BinaryDictionaryBuilder) Cap() int

func (*BinaryDictionaryBuilder) DictionarySize

func (b *BinaryDictionaryBuilder) DictionarySize() int

func (*BinaryDictionaryBuilder) GetValueIndex

func (b *BinaryDictionaryBuilder) GetValueIndex(i int) int

func (*BinaryDictionaryBuilder) IndexBuilder

func (b *BinaryDictionaryBuilder) IndexBuilder() IndexBuilder

func (*BinaryDictionaryBuilder) InsertDictValues

func (b *BinaryDictionaryBuilder) InsertDictValues(arr *Binary) (err error)

func (*BinaryDictionaryBuilder) InsertStringDictValues

func (b *BinaryDictionaryBuilder) InsertStringDictValues(arr *String) (err error)

func (*BinaryDictionaryBuilder) IsNull

func (b *BinaryDictionaryBuilder) IsNull(i int) bool

func (*BinaryDictionaryBuilder) NewArray

func (b *BinaryDictionaryBuilder) NewArray() arrow.Array

func (*BinaryDictionaryBuilder) NewDelta

func (b *BinaryDictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*BinaryDictionaryBuilder) NewDictionaryArray

func (b *BinaryDictionaryBuilder) NewDictionaryArray() *Dictionary

func (*BinaryDictionaryBuilder) Release

func (b *BinaryDictionaryBuilder) Release()

func (*BinaryDictionaryBuilder) Reserve

func (b *BinaryDictionaryBuilder) Reserve(n int)

func (*BinaryDictionaryBuilder) ResetFull

func (b *BinaryDictionaryBuilder) ResetFull()

func (*BinaryDictionaryBuilder) Resize

func (b *BinaryDictionaryBuilder) Resize(n int)

func (*BinaryDictionaryBuilder) Type

func (b *BinaryDictionaryBuilder) Type() arrow.DataType

func (*BinaryDictionaryBuilder) Unmarshal

func (b *BinaryDictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*BinaryDictionaryBuilder) UnmarshalJSON

func (b *BinaryDictionaryBuilder) UnmarshalJSON(data []byte) error

func (*BinaryDictionaryBuilder) UnmarshalOne

func (b *BinaryDictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

func (*BinaryDictionaryBuilder) Value

func (b *BinaryDictionaryBuilder) Value(i int) []byte

func (*BinaryDictionaryBuilder) ValueStr

func (b *BinaryDictionaryBuilder) ValueStr(i int) string

type BinaryLike

type BinaryLike interface {
	arrow.Array
	ValueLen(int) int
	ValueBytes() []byte
	ValueOffset64(int) int64
}

type BinaryView

type BinaryView struct {
	// contains filtered or unexported fields
}

func NewBinaryViewData

func NewBinaryViewData(data arrow.ArrayData) *BinaryView

func (*BinaryView) Data

func (a *BinaryView) Data() arrow.ArrayData

func (*BinaryView) DataType

func (a *BinaryView) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*BinaryView) GetOneForMarshal

func (a *BinaryView) GetOneForMarshal(i int) interface{}

func (*BinaryView) IsNull

func (a *BinaryView) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*BinaryView) IsValid

func (a *BinaryView) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*BinaryView) Len

func (a *BinaryView) Len() int

Len returns the number of elements in the array.

func (*BinaryView) MarshalJSON

func (a *BinaryView) MarshalJSON() ([]byte, error)

func (*BinaryView) NullBitmapBytes

func (a *BinaryView) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*BinaryView) NullN

func (a *BinaryView) NullN() int

NullN returns the number of null values in the array.

func (*BinaryView) Offset

func (a *BinaryView) Offset() int

func (*BinaryView) Release

func (a *BinaryView) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*BinaryView) Retain

func (a *BinaryView) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*BinaryView) String

func (a *BinaryView) String() string

func (*BinaryView) Value

func (a *BinaryView) Value(i int) []byte

func (*BinaryView) ValueHeader

func (a *BinaryView) ValueHeader(i int) *arrow.ViewHeader

func (*BinaryView) ValueLen

func (a *BinaryView) ValueLen(i int) int

func (*BinaryView) ValueStr

func (a *BinaryView) ValueStr(i int) string

ValueStr is paired with AppendValueFromString in that it returns the value at index i as a string: Semantically this means that for a null value it will return the string "(null)", otherwise it will return the value as a base64 encoded string suitable for CSV/JSON.

This is always going to be less performant than just using ValueString and exists to fulfill the Array interface to provide a method which can produce a human readable string for a given index.

func (*BinaryView) ValueString

func (a *BinaryView) ValueString(i int) string

ValueString returns the value at index i as a string instead of a byte slice, without copying the underlying data.

type BinaryViewBuilder

type BinaryViewBuilder struct {
	// contains filtered or unexported fields
}

func NewBinaryViewBuilder

func NewBinaryViewBuilder(mem memory.Allocator) *BinaryViewBuilder

func (*BinaryViewBuilder) Append

func (b *BinaryViewBuilder) Append(v []byte)

func (*BinaryViewBuilder) AppendEmptyValue

func (b *BinaryViewBuilder) AppendEmptyValue()

func (*BinaryViewBuilder) AppendEmptyValues

func (b *BinaryViewBuilder) AppendEmptyValues(n int)

func (*BinaryViewBuilder) AppendNull

func (b *BinaryViewBuilder) AppendNull()

func (*BinaryViewBuilder) AppendNulls

func (b *BinaryViewBuilder) AppendNulls(n int)

func (*BinaryViewBuilder) AppendString

func (b *BinaryViewBuilder) AppendString(v string)

AppendString is identical to Append, only accepting a string instead of a byte slice, avoiding the extra copy that would occur if you simply did []byte(v).

This is different than AppendValueFromString which exists for the Builder interface, in that this expects raw binary data which is appended unmodified. AppendValueFromString expects base64 encoded binary data instead.

func (*BinaryViewBuilder) AppendStringValues

func (b *BinaryViewBuilder) AppendStringValues(v []string, valid []bool)

func (*BinaryViewBuilder) AppendValueFromString

func (b *BinaryViewBuilder) AppendValueFromString(s string) error

AppendValueFromString is paired with ValueStr for fulfilling the base Builder interface. This is intended to read in a human-readable string such as from CSV or JSON and append it to the array.

For Binary values are expected to be base64 encoded (and will be decoded as such before being appended).

func (*BinaryViewBuilder) AppendValues

func (b *BinaryViewBuilder) AppendValues(v [][]byte, valid []bool)

func (*BinaryViewBuilder) Cap

func (b *BinaryViewBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*BinaryViewBuilder) IsNull

func (b *BinaryViewBuilder) IsNull(i int) bool

func (*BinaryViewBuilder) Len

func (b *BinaryViewBuilder) Len() int

Len returns the number of elements in the array builder.

func (*BinaryViewBuilder) NewArray

func (b *BinaryViewBuilder) NewArray() arrow.Array

func (*BinaryViewBuilder) NewBinaryViewArray

func (b *BinaryViewBuilder) NewBinaryViewArray() (a *BinaryView)

func (*BinaryViewBuilder) NullN

func (b *BinaryViewBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*BinaryViewBuilder) Release

func (b *BinaryViewBuilder) Release()

func (*BinaryViewBuilder) Reserve

func (b *BinaryViewBuilder) Reserve(n int)

func (*BinaryViewBuilder) ReserveData

func (b *BinaryViewBuilder) ReserveData(length int)

func (*BinaryViewBuilder) Resize

func (b *BinaryViewBuilder) Resize(n int)

func (*BinaryViewBuilder) Retain

func (b *BinaryViewBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*BinaryViewBuilder) SetBlockSize

func (b *BinaryViewBuilder) SetBlockSize(sz uint)

func (*BinaryViewBuilder) SetNull

func (b *BinaryViewBuilder) SetNull(i int)

func (*BinaryViewBuilder) Type

func (b *BinaryViewBuilder) Type() arrow.DataType

func (*BinaryViewBuilder) Unmarshal

func (b *BinaryViewBuilder) Unmarshal(dec *json.Decoder) error

func (*BinaryViewBuilder) UnmarshalJSON

func (b *BinaryViewBuilder) UnmarshalJSON(data []byte) error

func (*BinaryViewBuilder) UnmarshalOne

func (b *BinaryViewBuilder) UnmarshalOne(dec *json.Decoder) error

func (*BinaryViewBuilder) UnsafeAppend

func (b *BinaryViewBuilder) UnsafeAppend(v []byte)

func (*BinaryViewBuilder) UnsafeAppendBoolToBitmap

func (b *BinaryViewBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type Boolean

type Boolean struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of boolean values.

func NewBoolean

func NewBoolean(length int, data *memory.Buffer, nullBitmap *memory.Buffer, nulls int) *Boolean

NewBoolean creates a boolean array from the data memory.Buffer and contains length elements. The nullBitmap buffer can be nil of there are no null values. If nulls is not known, use UnknownNullCount to calculate the value of NullN at runtime from the nullBitmap buffer.

func NewBooleanData

func NewBooleanData(data arrow.ArrayData) *Boolean

func (*Boolean) Data

func (a *Boolean) Data() arrow.ArrayData

func (*Boolean) DataType

func (a *Boolean) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Boolean) GetOneForMarshal

func (a *Boolean) GetOneForMarshal(i int) interface{}

func (*Boolean) IsNull

func (a *Boolean) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Boolean) IsValid

func (a *Boolean) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Boolean) Len

func (a *Boolean) Len() int

Len returns the number of elements in the array.

func (*Boolean) MarshalJSON

func (a *Boolean) MarshalJSON() ([]byte, error)

func (*Boolean) NullBitmapBytes

func (a *Boolean) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Boolean) NullN

func (a *Boolean) NullN() int

NullN returns the number of null values in the array.

func (*Boolean) Offset

func (a *Boolean) Offset() int

func (*Boolean) Release

func (a *Boolean) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Boolean) Retain

func (a *Boolean) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Boolean) String

func (a *Boolean) String() string

func (*Boolean) Value

func (a *Boolean) Value(i int) bool

func (*Boolean) ValueStr

func (a *Boolean) ValueStr(i int) string

type BooleanBuilder

type BooleanBuilder struct {
	// contains filtered or unexported fields
}

func NewBooleanBuilder

func NewBooleanBuilder(mem memory.Allocator) *BooleanBuilder

func (*BooleanBuilder) Append

func (b *BooleanBuilder) Append(v bool)

func (*BooleanBuilder) AppendByte

func (b *BooleanBuilder) AppendByte(v byte)

func (*BooleanBuilder) AppendEmptyValue

func (b *BooleanBuilder) AppendEmptyValue()

func (*BooleanBuilder) AppendEmptyValues

func (b *BooleanBuilder) AppendEmptyValues(n int)

func (*BooleanBuilder) AppendNull

func (b *BooleanBuilder) AppendNull()

func (*BooleanBuilder) AppendNulls

func (b *BooleanBuilder) AppendNulls(n int)

func (*BooleanBuilder) AppendValueFromString

func (b *BooleanBuilder) AppendValueFromString(s string) error

func (*BooleanBuilder) AppendValues

func (b *BooleanBuilder) AppendValues(v []bool, valid []bool)

func (*BooleanBuilder) Cap

func (b *BooleanBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*BooleanBuilder) IsNull

func (b *BooleanBuilder) IsNull(i int) bool

func (*BooleanBuilder) Len

func (b *BooleanBuilder) Len() int

Len returns the number of elements in the array builder.

func (*BooleanBuilder) NewArray

func (b *BooleanBuilder) NewArray() arrow.Array

NewArray creates a Boolean array from the memory buffers used by the builder and resets the BooleanBuilder so it can be used to build a new array.

func (*BooleanBuilder) NewBooleanArray

func (b *BooleanBuilder) NewBooleanArray() (a *Boolean)

NewBooleanArray creates a Boolean array from the memory buffers used by the builder and resets the BooleanBuilder so it can be used to build a new array.

func (*BooleanBuilder) NullN

func (b *BooleanBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*BooleanBuilder) Release

func (b *BooleanBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed. Release may be called simultaneously from multiple goroutines.

func (*BooleanBuilder) Reserve

func (b *BooleanBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*BooleanBuilder) Resize

func (b *BooleanBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*BooleanBuilder) Retain

func (b *BooleanBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*BooleanBuilder) SetNull

func (b *BooleanBuilder) SetNull(i int)

func (*BooleanBuilder) Type

func (b *BooleanBuilder) Type() arrow.DataType

func (*BooleanBuilder) Unmarshal

func (b *BooleanBuilder) Unmarshal(dec *json.Decoder) error

func (*BooleanBuilder) UnmarshalJSON

func (b *BooleanBuilder) UnmarshalJSON(data []byte) error

func (*BooleanBuilder) UnmarshalOne

func (b *BooleanBuilder) UnmarshalOne(dec *json.Decoder) error

func (*BooleanBuilder) UnsafeAppend

func (b *BooleanBuilder) UnsafeAppend(v bool)

func (*BooleanBuilder) UnsafeAppendBoolToBitmap

func (b *BooleanBuilder) UnsafeAppendBoolToBitmap(isValid bool)

func (*BooleanBuilder) Value

func (b *BooleanBuilder) Value(i int) bool

type Builder

type Builder interface {
	// you can unmarshal a json array to add the values to a builder
	json.Unmarshaler

	// Type returns the datatype that this is building
	Type() arrow.DataType

	// Retain increases the reference count by 1.
	// Retain may be called simultaneously from multiple goroutines.
	Retain()

	// Release decreases the reference count by 1.
	Release()

	// Len returns the number of elements in the array builder.
	Len() int

	// Cap returns the total number of elements that can be stored
	// without allocating additional memory.
	Cap() int

	// NullN returns the number of null values in the array builder.
	NullN() int

	// AppendNull adds a new null value to the array being built.
	AppendNull()

	// AppendNulls adds new n null values to the array being built.
	AppendNulls(n int)

	// AppendEmptyValue adds a new zero value of the appropriate type
	AppendEmptyValue()

	// AppendEmptyValues adds new n zero values of the appropriate type
	AppendEmptyValues(n int)

	// AppendValueFromString adds a new value from a string. Inverse of array.ValueStr(i int) string
	AppendValueFromString(string) error

	// Reserve ensures there is enough space for appending n elements
	// by checking the capacity and calling Resize if necessary.
	Reserve(n int)

	// Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(),
	// additional memory will be allocated. If n is smaller, the allocated memory may reduced.
	Resize(n int)

	// NewArray creates a new array from the memory buffers used
	// by the builder and resets the Builder so it can be used to build
	// a new array.
	NewArray() arrow.Array

	// IsNull returns if a previously appended value at a given index is null or not.
	IsNull(i int) bool

	// SetNull sets the value at index i to null.
	SetNull(i int)

	UnsafeAppendBoolToBitmap(bool)

	UnmarshalOne(*json.Decoder) error
	Unmarshal(*json.Decoder) error
	// contains filtered or unexported methods
}

Builder provides an interface to build arrow arrays.

func NewBuilder

func NewBuilder(mem memory.Allocator, dtype arrow.DataType) Builder

type Data

type Data struct {
	// contains filtered or unexported fields
}

Data represents the memory and metadata of an Arrow array.

func GetDictArrayData

func GetDictArrayData(mem memory.Allocator, valueType arrow.DataType, memoTable hashing.MemoTable, startOffset int) (*Data, error)

func NewData

func NewData(dtype arrow.DataType, length int, buffers []*memory.Buffer, childData []arrow.ArrayData, nulls, offset int) *Data

NewData creates a new Data.

func NewDataWithDictionary

func NewDataWithDictionary(dtype arrow.DataType, length int, buffers []*memory.Buffer, nulls, offset int, dict *Data) *Data

NewDataWithDictionary creates a new data object, but also sets the provided dictionary into the data if it's not nil

func (*Data) Buffers

func (d *Data) Buffers() []*memory.Buffer

Buffers returns the buffers.

func (*Data) Children

func (d *Data) Children() []arrow.ArrayData

func (*Data) Copy

func (d *Data) Copy() *Data

func (*Data) DataType

func (d *Data) DataType() arrow.DataType

DataType returns the DataType of the data.

func (*Data) Dictionary

func (d *Data) Dictionary() arrow.ArrayData

Dictionary returns the ArrayData object for the dictionary member, or nil

func (*Data) Len

func (d *Data) Len() int

Len returns the length.

func (*Data) NullN

func (d *Data) NullN() int

NullN returns the number of nulls.

func (*Data) Offset

func (d *Data) Offset() int

Offset returns the offset.

func (*Data) Release

func (d *Data) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed. Release may be called simultaneously from multiple goroutines.

func (*Data) Reset

func (d *Data) Reset(dtype arrow.DataType, length int, buffers []*memory.Buffer, childData []arrow.ArrayData, nulls, offset int)

Reset sets the Data for re-use.

func (*Data) Retain

func (d *Data) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Data) SetDictionary

func (d *Data) SetDictionary(dict arrow.ArrayData)

SetDictionary allows replacing the dictionary for this particular Data object

func (*Data) SetNullN

func (d *Data) SetNullN(n int)

func (*Data) SizeInBytes

func (d *Data) SizeInBytes() uint64

SizeInBytes returns the size of the Data and any children and/or dictionary in bytes by recursively examining the nested structures of children and/or dictionary. The value returned is an upper-bound since offset is not taken into account.

type Date32

type Date32 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of arrow.Date32 values.

func NewDate32Data

func NewDate32Data(data arrow.ArrayData) *Date32

NewDate32Data creates a new Date32.

func (*Date32) Data

func (a *Date32) Data() arrow.ArrayData

func (*Date32) DataType

func (a *Date32) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Date32) Date32Values

func (a *Date32) Date32Values() []arrow.Date32

Values returns the values.

func (*Date32) GetOneForMarshal

func (a *Date32) GetOneForMarshal(i int) interface{}

func (*Date32) IsNull

func (a *Date32) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Date32) IsValid

func (a *Date32) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Date32) Len

func (a *Date32) Len() int

Len returns the number of elements in the array.

func (*Date32) MarshalJSON

func (a *Date32) MarshalJSON() ([]byte, error)

func (*Date32) NullBitmapBytes

func (a *Date32) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Date32) NullN

func (a *Date32) NullN() int

NullN returns the number of null values in the array.

func (*Date32) Offset

func (a *Date32) Offset() int

func (*Date32) Release

func (a *Date32) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Date32) Reset

func (a *Date32) Reset(data *Data)

Reset resets the array for re-use.

func (*Date32) Retain

func (a *Date32) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Date32) String

func (a *Date32) String() string

String returns a string representation of the array.

func (*Date32) Value

func (a *Date32) Value(i int) arrow.Date32

Value returns the value at the specified index.

func (*Date32) ValueStr

func (a *Date32) ValueStr(i int) string

type Date32Builder

type Date32Builder struct {
	// contains filtered or unexported fields
}

func NewDate32Builder

func NewDate32Builder(mem memory.Allocator) *Date32Builder

func (*Date32Builder) Append

func (b *Date32Builder) Append(v arrow.Date32)

func (*Date32Builder) AppendEmptyValue

func (b *Date32Builder) AppendEmptyValue()

func (*Date32Builder) AppendEmptyValues

func (b *Date32Builder) AppendEmptyValues(n int)

func (*Date32Builder) AppendNull

func (b *Date32Builder) AppendNull()

func (*Date32Builder) AppendNulls

func (b *Date32Builder) AppendNulls(n int)

func (*Date32Builder) AppendValueFromString

func (b *Date32Builder) AppendValueFromString(s string) error

func (*Date32Builder) AppendValues

func (b *Date32Builder) AppendValues(v []arrow.Date32, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Date32Builder) Cap

func (b *Date32Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Date32Builder) IsNull

func (b *Date32Builder) IsNull(i int) bool

func (*Date32Builder) Len

func (b *Date32Builder) Len() int

Len returns the number of elements in the array builder.

func (*Date32Builder) NewArray

func (b *Date32Builder) NewArray() arrow.Array

NewArray creates a Date32 array from the memory buffers used by the builder and resets the Date32Builder so it can be used to build a new array.

func (*Date32Builder) NewDate32Array

func (b *Date32Builder) NewDate32Array() (a *Date32)

NewDate32Array creates a Date32 array from the memory buffers used by the builder and resets the Date32Builder so it can be used to build a new array.

func (*Date32Builder) NullN

func (b *Date32Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Date32Builder) Release

func (b *Date32Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Date32Builder) Reserve

func (b *Date32Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Date32Builder) Resize

func (b *Date32Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Date32Builder) Retain

func (b *Date32Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Date32Builder) SetNull

func (b *Date32Builder) SetNull(i int)

func (*Date32Builder) Type

func (b *Date32Builder) Type() arrow.DataType

func (*Date32Builder) Unmarshal

func (b *Date32Builder) Unmarshal(dec *json.Decoder) error

func (*Date32Builder) UnmarshalJSON

func (b *Date32Builder) UnmarshalJSON(data []byte) error

func (*Date32Builder) UnmarshalOne

func (b *Date32Builder) UnmarshalOne(dec *json.Decoder) error

func (*Date32Builder) UnsafeAppend

func (b *Date32Builder) UnsafeAppend(v arrow.Date32)

func (*Date32Builder) UnsafeAppendBoolToBitmap

func (b *Date32Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Date32Builder) Value

func (b *Date32Builder) Value(i int) arrow.Date32

type Date32DictionaryBuilder

type Date32DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Date32DictionaryBuilder) Append

func (*Date32DictionaryBuilder) AppendArray

func (b *Date32DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Date32DictionaryBuilder) AppendEmptyValue

func (b *Date32DictionaryBuilder) AppendEmptyValue()

func (*Date32DictionaryBuilder) AppendEmptyValues

func (b *Date32DictionaryBuilder) AppendEmptyValues(n int)

func (*Date32DictionaryBuilder) AppendIndices

func (b *Date32DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Date32DictionaryBuilder) AppendNull

func (b *Date32DictionaryBuilder) AppendNull()

func (*Date32DictionaryBuilder) AppendNulls

func (b *Date32DictionaryBuilder) AppendNulls(n int)

func (*Date32DictionaryBuilder) AppendValueFromString

func (b *Date32DictionaryBuilder) AppendValueFromString(s string) error

func (*Date32DictionaryBuilder) Cap

func (b *Date32DictionaryBuilder) Cap() int

func (*Date32DictionaryBuilder) DictionarySize

func (b *Date32DictionaryBuilder) DictionarySize() int

func (*Date32DictionaryBuilder) IndexBuilder

func (b *Date32DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Date32DictionaryBuilder) InsertDictValues

func (b *Date32DictionaryBuilder) InsertDictValues(arr *Date32) (err error)

func (*Date32DictionaryBuilder) IsNull

func (b *Date32DictionaryBuilder) IsNull(i int) bool

func (*Date32DictionaryBuilder) NewArray

func (b *Date32DictionaryBuilder) NewArray() arrow.Array

func (*Date32DictionaryBuilder) NewDelta

func (b *Date32DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Date32DictionaryBuilder) NewDictionaryArray

func (b *Date32DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Date32DictionaryBuilder) Release

func (b *Date32DictionaryBuilder) Release()

func (*Date32DictionaryBuilder) Reserve

func (b *Date32DictionaryBuilder) Reserve(n int)

func (*Date32DictionaryBuilder) ResetFull

func (b *Date32DictionaryBuilder) ResetFull()

func (*Date32DictionaryBuilder) Resize

func (b *Date32DictionaryBuilder) Resize(n int)

func (*Date32DictionaryBuilder) Type

func (b *Date32DictionaryBuilder) Type() arrow.DataType

func (*Date32DictionaryBuilder) Unmarshal

func (b *Date32DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Date32DictionaryBuilder) UnmarshalJSON

func (b *Date32DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Date32DictionaryBuilder) UnmarshalOne

func (b *Date32DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Date64

type Date64 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of arrow.Date64 values.

func NewDate64Data

func NewDate64Data(data arrow.ArrayData) *Date64

NewDate64Data creates a new Date64.

func (*Date64) Data

func (a *Date64) Data() arrow.ArrayData

func (*Date64) DataType

func (a *Date64) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Date64) Date64Values

func (a *Date64) Date64Values() []arrow.Date64

Values returns the values.

func (*Date64) GetOneForMarshal

func (a *Date64) GetOneForMarshal(i int) interface{}

func (*Date64) IsNull

func (a *Date64) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Date64) IsValid

func (a *Date64) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Date64) Len

func (a *Date64) Len() int

Len returns the number of elements in the array.

func (*Date64) MarshalJSON

func (a *Date64) MarshalJSON() ([]byte, error)

func (*Date64) NullBitmapBytes

func (a *Date64) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Date64) NullN

func (a *Date64) NullN() int

NullN returns the number of null values in the array.

func (*Date64) Offset

func (a *Date64) Offset() int

func (*Date64) Release

func (a *Date64) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Date64) Reset

func (a *Date64) Reset(data *Data)

Reset resets the array for re-use.

func (*Date64) Retain

func (a *Date64) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Date64) String

func (a *Date64) String() string

String returns a string representation of the array.

func (*Date64) Value

func (a *Date64) Value(i int) arrow.Date64

Value returns the value at the specified index.

func (*Date64) ValueStr

func (a *Date64) ValueStr(i int) string

type Date64Builder

type Date64Builder struct {
	// contains filtered or unexported fields
}

func NewDate64Builder

func NewDate64Builder(mem memory.Allocator) *Date64Builder

func (*Date64Builder) Append

func (b *Date64Builder) Append(v arrow.Date64)

func (*Date64Builder) AppendEmptyValue

func (b *Date64Builder) AppendEmptyValue()

func (*Date64Builder) AppendEmptyValues

func (b *Date64Builder) AppendEmptyValues(n int)

func (*Date64Builder) AppendNull

func (b *Date64Builder) AppendNull()

func (*Date64Builder) AppendNulls

func (b *Date64Builder) AppendNulls(n int)

func (*Date64Builder) AppendValueFromString

func (b *Date64Builder) AppendValueFromString(s string) error

func (*Date64Builder) AppendValues

func (b *Date64Builder) AppendValues(v []arrow.Date64, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Date64Builder) Cap

func (b *Date64Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Date64Builder) IsNull

func (b *Date64Builder) IsNull(i int) bool

func (*Date64Builder) Len

func (b *Date64Builder) Len() int

Len returns the number of elements in the array builder.

func (*Date64Builder) NewArray

func (b *Date64Builder) NewArray() arrow.Array

NewArray creates a Date64 array from the memory buffers used by the builder and resets the Date64Builder so it can be used to build a new array.

func (*Date64Builder) NewDate64Array

func (b *Date64Builder) NewDate64Array() (a *Date64)

NewDate64Array creates a Date64 array from the memory buffers used by the builder and resets the Date64Builder so it can be used to build a new array.

func (*Date64Builder) NullN

func (b *Date64Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Date64Builder) Release

func (b *Date64Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Date64Builder) Reserve

func (b *Date64Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Date64Builder) Resize

func (b *Date64Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Date64Builder) Retain

func (b *Date64Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Date64Builder) SetNull

func (b *Date64Builder) SetNull(i int)

func (*Date64Builder) Type

func (b *Date64Builder) Type() arrow.DataType

func (*Date64Builder) Unmarshal

func (b *Date64Builder) Unmarshal(dec *json.Decoder) error

func (*Date64Builder) UnmarshalJSON

func (b *Date64Builder) UnmarshalJSON(data []byte) error

func (*Date64Builder) UnmarshalOne

func (b *Date64Builder) UnmarshalOne(dec *json.Decoder) error

func (*Date64Builder) UnsafeAppend

func (b *Date64Builder) UnsafeAppend(v arrow.Date64)

func (*Date64Builder) UnsafeAppendBoolToBitmap

func (b *Date64Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Date64Builder) Value

func (b *Date64Builder) Value(i int) arrow.Date64

type Date64DictionaryBuilder

type Date64DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Date64DictionaryBuilder) Append

func (*Date64DictionaryBuilder) AppendArray

func (b *Date64DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Date64DictionaryBuilder) AppendEmptyValue

func (b *Date64DictionaryBuilder) AppendEmptyValue()

func (*Date64DictionaryBuilder) AppendEmptyValues

func (b *Date64DictionaryBuilder) AppendEmptyValues(n int)

func (*Date64DictionaryBuilder) AppendIndices

func (b *Date64DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Date64DictionaryBuilder) AppendNull

func (b *Date64DictionaryBuilder) AppendNull()

func (*Date64DictionaryBuilder) AppendNulls

func (b *Date64DictionaryBuilder) AppendNulls(n int)

func (*Date64DictionaryBuilder) AppendValueFromString

func (b *Date64DictionaryBuilder) AppendValueFromString(s string) error

func (*Date64DictionaryBuilder) Cap

func (b *Date64DictionaryBuilder) Cap() int

func (*Date64DictionaryBuilder) DictionarySize

func (b *Date64DictionaryBuilder) DictionarySize() int

func (*Date64DictionaryBuilder) IndexBuilder

func (b *Date64DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Date64DictionaryBuilder) InsertDictValues

func (b *Date64DictionaryBuilder) InsertDictValues(arr *Date64) (err error)

func (*Date64DictionaryBuilder) IsNull

func (b *Date64DictionaryBuilder) IsNull(i int) bool

func (*Date64DictionaryBuilder) NewArray

func (b *Date64DictionaryBuilder) NewArray() arrow.Array

func (*Date64DictionaryBuilder) NewDelta

func (b *Date64DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Date64DictionaryBuilder) NewDictionaryArray

func (b *Date64DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Date64DictionaryBuilder) Release

func (b *Date64DictionaryBuilder) Release()

func (*Date64DictionaryBuilder) Reserve

func (b *Date64DictionaryBuilder) Reserve(n int)

func (*Date64DictionaryBuilder) ResetFull

func (b *Date64DictionaryBuilder) ResetFull()

func (*Date64DictionaryBuilder) Resize

func (b *Date64DictionaryBuilder) Resize(n int)

func (*Date64DictionaryBuilder) Type

func (b *Date64DictionaryBuilder) Type() arrow.DataType

func (*Date64DictionaryBuilder) Unmarshal

func (b *Date64DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Date64DictionaryBuilder) UnmarshalJSON

func (b *Date64DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Date64DictionaryBuilder) UnmarshalOne

func (b *Date64DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type DayTimeDictionaryBuilder

type DayTimeDictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*DayTimeDictionaryBuilder) Append

func (*DayTimeDictionaryBuilder) AppendArray

func (b *DayTimeDictionaryBuilder) AppendArray(arr arrow.Array) error

func (*DayTimeDictionaryBuilder) AppendEmptyValue

func (b *DayTimeDictionaryBuilder) AppendEmptyValue()

func (*DayTimeDictionaryBuilder) AppendEmptyValues

func (b *DayTimeDictionaryBuilder) AppendEmptyValues(n int)

func (*DayTimeDictionaryBuilder) AppendIndices

func (b *DayTimeDictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*DayTimeDictionaryBuilder) AppendNull

func (b *DayTimeDictionaryBuilder) AppendNull()

func (*DayTimeDictionaryBuilder) AppendNulls

func (b *DayTimeDictionaryBuilder) AppendNulls(n int)

func (*DayTimeDictionaryBuilder) AppendValueFromString

func (b *DayTimeDictionaryBuilder) AppendValueFromString(s string) error

func (*DayTimeDictionaryBuilder) Cap

func (b *DayTimeDictionaryBuilder) Cap() int

func (*DayTimeDictionaryBuilder) DictionarySize

func (b *DayTimeDictionaryBuilder) DictionarySize() int

func (*DayTimeDictionaryBuilder) IndexBuilder

func (b *DayTimeDictionaryBuilder) IndexBuilder() IndexBuilder

func (*DayTimeDictionaryBuilder) InsertDictValues

func (b *DayTimeDictionaryBuilder) InsertDictValues(arr *DayTimeInterval) (err error)

func (*DayTimeDictionaryBuilder) IsNull

func (b *DayTimeDictionaryBuilder) IsNull(i int) bool

func (*DayTimeDictionaryBuilder) NewArray

func (b *DayTimeDictionaryBuilder) NewArray() arrow.Array

func (*DayTimeDictionaryBuilder) NewDelta

func (b *DayTimeDictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*DayTimeDictionaryBuilder) NewDictionaryArray

func (b *DayTimeDictionaryBuilder) NewDictionaryArray() *Dictionary

func (*DayTimeDictionaryBuilder) Release

func (b *DayTimeDictionaryBuilder) Release()

func (*DayTimeDictionaryBuilder) Reserve

func (b *DayTimeDictionaryBuilder) Reserve(n int)

func (*DayTimeDictionaryBuilder) ResetFull

func (b *DayTimeDictionaryBuilder) ResetFull()

func (*DayTimeDictionaryBuilder) Resize

func (b *DayTimeDictionaryBuilder) Resize(n int)

func (*DayTimeDictionaryBuilder) Type

func (b *DayTimeDictionaryBuilder) Type() arrow.DataType

func (*DayTimeDictionaryBuilder) Unmarshal

func (b *DayTimeDictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*DayTimeDictionaryBuilder) UnmarshalJSON

func (b *DayTimeDictionaryBuilder) UnmarshalJSON(data []byte) error

func (*DayTimeDictionaryBuilder) UnmarshalOne

func (b *DayTimeDictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type DayTimeInterval

type DayTimeInterval struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of arrow.DayTimeInterval values.

func NewDayTimeIntervalData

func NewDayTimeIntervalData(data arrow.ArrayData) *DayTimeInterval

func (*DayTimeInterval) Data

func (a *DayTimeInterval) Data() arrow.ArrayData

func (*DayTimeInterval) DataType

func (a *DayTimeInterval) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*DayTimeInterval) DayTimeIntervalValues

func (a *DayTimeInterval) DayTimeIntervalValues() []arrow.DayTimeInterval

func (*DayTimeInterval) GetOneForMarshal

func (a *DayTimeInterval) GetOneForMarshal(i int) interface{}

func (*DayTimeInterval) IsNull

func (a *DayTimeInterval) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*DayTimeInterval) IsValid

func (a *DayTimeInterval) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*DayTimeInterval) Len

func (a *DayTimeInterval) Len() int

Len returns the number of elements in the array.

func (*DayTimeInterval) MarshalJSON

func (a *DayTimeInterval) MarshalJSON() ([]byte, error)

MarshalJSON will marshal this array to JSON as an array of objects, consisting of the form {"days": #, "milliseconds": #} for each element.

func (*DayTimeInterval) NullBitmapBytes

func (a *DayTimeInterval) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*DayTimeInterval) NullN

func (a *DayTimeInterval) NullN() int

NullN returns the number of null values in the array.

func (*DayTimeInterval) Offset

func (a *DayTimeInterval) Offset() int

func (*DayTimeInterval) Release

func (a *DayTimeInterval) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*DayTimeInterval) Retain

func (a *DayTimeInterval) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*DayTimeInterval) String

func (a *DayTimeInterval) String() string

func (*DayTimeInterval) Value

func (*DayTimeInterval) ValueStr

func (a *DayTimeInterval) ValueStr(i int) string

type DayTimeIntervalBuilder

type DayTimeIntervalBuilder struct {
	// contains filtered or unexported fields
}

func NewDayTimeIntervalBuilder

func NewDayTimeIntervalBuilder(mem memory.Allocator) *DayTimeIntervalBuilder

func (*DayTimeIntervalBuilder) Append

func (*DayTimeIntervalBuilder) AppendEmptyValue

func (b *DayTimeIntervalBuilder) AppendEmptyValue()

func (*DayTimeIntervalBuilder) AppendEmptyValues

func (b *DayTimeIntervalBuilder) AppendEmptyValues(n int)

func (*DayTimeIntervalBuilder) AppendNull

func (b *DayTimeIntervalBuilder) AppendNull()

func (*DayTimeIntervalBuilder) AppendNulls

func (b *DayTimeIntervalBuilder) AppendNulls(n int)

func (*DayTimeIntervalBuilder) AppendValueFromString

func (b *DayTimeIntervalBuilder) AppendValueFromString(s string) error

func (*DayTimeIntervalBuilder) AppendValues

func (b *DayTimeIntervalBuilder) AppendValues(v []arrow.DayTimeInterval, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*DayTimeIntervalBuilder) Cap

func (b *DayTimeIntervalBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*DayTimeIntervalBuilder) IsNull

func (b *DayTimeIntervalBuilder) IsNull(i int) bool

func (*DayTimeIntervalBuilder) Len

func (b *DayTimeIntervalBuilder) Len() int

Len returns the number of elements in the array builder.

func (*DayTimeIntervalBuilder) NewArray

func (b *DayTimeIntervalBuilder) NewArray() arrow.Array

NewArray creates a DayTimeInterval array from the memory buffers used by the builder and resets the DayTimeIntervalBuilder so it can be used to build a new array.

func (*DayTimeIntervalBuilder) NewDayTimeIntervalArray

func (b *DayTimeIntervalBuilder) NewDayTimeIntervalArray() (a *DayTimeInterval)

NewDayTimeIntervalArray creates a DayTimeInterval array from the memory buffers used by the builder and resets the DayTimeIntervalBuilder so it can be used to build a new array.

func (*DayTimeIntervalBuilder) NullN

func (b *DayTimeIntervalBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*DayTimeIntervalBuilder) Release

func (b *DayTimeIntervalBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*DayTimeIntervalBuilder) Reserve

func (b *DayTimeIntervalBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*DayTimeIntervalBuilder) Resize

func (b *DayTimeIntervalBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*DayTimeIntervalBuilder) Retain

func (b *DayTimeIntervalBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*DayTimeIntervalBuilder) SetNull

func (b *DayTimeIntervalBuilder) SetNull(i int)

func (*DayTimeIntervalBuilder) Type

func (*DayTimeIntervalBuilder) Unmarshal

func (b *DayTimeIntervalBuilder) Unmarshal(dec *json.Decoder) error

func (*DayTimeIntervalBuilder) UnmarshalJSON

func (b *DayTimeIntervalBuilder) UnmarshalJSON(data []byte) error

UnmarshalJSON will add the values unmarshalled from an array to the builder, with the values expected to be objects of the form {"days": #, "milliseconds": #}

func (*DayTimeIntervalBuilder) UnmarshalOne

func (b *DayTimeIntervalBuilder) UnmarshalOne(dec *json.Decoder) error

func (*DayTimeIntervalBuilder) UnsafeAppend

func (b *DayTimeIntervalBuilder) UnsafeAppend(v arrow.DayTimeInterval)

func (*DayTimeIntervalBuilder) UnsafeAppendBoolToBitmap

func (b *DayTimeIntervalBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type Decimal128

type Decimal128 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of 128-bit decimal values.

func NewDecimal128Data

func NewDecimal128Data(data arrow.ArrayData) *Decimal128

func (*Decimal128) Data

func (a *Decimal128) Data() arrow.ArrayData

func (*Decimal128) DataType

func (a *Decimal128) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Decimal128) GetOneForMarshal

func (a *Decimal128) GetOneForMarshal(i int) interface{}

func (*Decimal128) IsNull

func (a *Decimal128) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Decimal128) IsValid

func (a *Decimal128) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Decimal128) Len

func (a *Decimal128) Len() int

Len returns the number of elements in the array.

func (*Decimal128) MarshalJSON

func (a *Decimal128) MarshalJSON() ([]byte, error)

["1.23", ]

func (*Decimal128) NullBitmapBytes

func (a *Decimal128) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Decimal128) NullN

func (a *Decimal128) NullN() int

NullN returns the number of null values in the array.

func (*Decimal128) Offset

func (a *Decimal128) Offset() int

func (*Decimal128) Release

func (a *Decimal128) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Decimal128) Retain

func (a *Decimal128) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Decimal128) String

func (a *Decimal128) String() string

func (*Decimal128) Value

func (a *Decimal128) Value(i int) decimal128.Num

func (*Decimal128) ValueStr

func (a *Decimal128) ValueStr(i int) string

func (*Decimal128) Values

func (a *Decimal128) Values() []decimal128.Num

type Decimal128Builder

type Decimal128Builder struct {
	// contains filtered or unexported fields
}

func NewDecimal128Builder

func NewDecimal128Builder(mem memory.Allocator, dtype *arrow.Decimal128Type) *Decimal128Builder

func (*Decimal128Builder) Append

func (b *Decimal128Builder) Append(v decimal128.Num)

func (*Decimal128Builder) AppendEmptyValue

func (b *Decimal128Builder) AppendEmptyValue()

func (*Decimal128Builder) AppendEmptyValues

func (b *Decimal128Builder) AppendEmptyValues(n int)

func (*Decimal128Builder) AppendNull

func (b *Decimal128Builder) AppendNull()

func (*Decimal128Builder) AppendNulls

func (b *Decimal128Builder) AppendNulls(n int)

func (*Decimal128Builder) AppendValueFromString

func (b *Decimal128Builder) AppendValueFromString(s string) error

func (*Decimal128Builder) AppendValues

func (b *Decimal128Builder) AppendValues(v []decimal128.Num, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Decimal128Builder) Cap

func (b *Decimal128Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Decimal128Builder) IsNull

func (b *Decimal128Builder) IsNull(i int) bool

func (*Decimal128Builder) Len

func (b *Decimal128Builder) Len() int

Len returns the number of elements in the array builder.

func (*Decimal128Builder) NewArray

func (b *Decimal128Builder) NewArray() arrow.Array

NewArray creates a Decimal128 array from the memory buffers used by the builder and resets the Decimal128Builder so it can be used to build a new array.

func (*Decimal128Builder) NewDecimal128Array

func (b *Decimal128Builder) NewDecimal128Array() (a *Decimal128)

NewDecimal128Array creates a Decimal128 array from the memory buffers used by the builder and resets the Decimal128Builder so it can be used to build a new array.

func (*Decimal128Builder) NullN

func (b *Decimal128Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Decimal128Builder) Release

func (b *Decimal128Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Decimal128Builder) Reserve

func (b *Decimal128Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Decimal128Builder) Resize

func (b *Decimal128Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Decimal128Builder) Retain

func (b *Decimal128Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Decimal128Builder) SetNull

func (b *Decimal128Builder) SetNull(i int)

func (*Decimal128Builder) Type

func (b *Decimal128Builder) Type() arrow.DataType

func (*Decimal128Builder) Unmarshal

func (b *Decimal128Builder) Unmarshal(dec *json.Decoder) error

func (*Decimal128Builder) UnmarshalJSON

func (b *Decimal128Builder) UnmarshalJSON(data []byte) error

UnmarshalJSON will add the unmarshalled values to this builder.

If the values are strings, they will get parsed with big.ParseFloat using a rounding mode of big.ToNearestAway currently.

func (*Decimal128Builder) UnmarshalOne

func (b *Decimal128Builder) UnmarshalOne(dec *json.Decoder) error

func (*Decimal128Builder) UnsafeAppend

func (b *Decimal128Builder) UnsafeAppend(v decimal128.Num)

func (*Decimal128Builder) UnsafeAppendBoolToBitmap

func (b *Decimal128Builder) UnsafeAppendBoolToBitmap(isValid bool)

type Decimal128DictionaryBuilder

type Decimal128DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Decimal128DictionaryBuilder) Append

func (*Decimal128DictionaryBuilder) AppendArray

func (b *Decimal128DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Decimal128DictionaryBuilder) AppendEmptyValue

func (b *Decimal128DictionaryBuilder) AppendEmptyValue()

func (*Decimal128DictionaryBuilder) AppendEmptyValues

func (b *Decimal128DictionaryBuilder) AppendEmptyValues(n int)

func (*Decimal128DictionaryBuilder) AppendIndices

func (b *Decimal128DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Decimal128DictionaryBuilder) AppendNull

func (b *Decimal128DictionaryBuilder) AppendNull()

func (*Decimal128DictionaryBuilder) AppendNulls

func (b *Decimal128DictionaryBuilder) AppendNulls(n int)

func (*Decimal128DictionaryBuilder) AppendValueFromString

func (b *Decimal128DictionaryBuilder) AppendValueFromString(s string) error

func (*Decimal128DictionaryBuilder) Cap

func (b *Decimal128DictionaryBuilder) Cap() int

func (*Decimal128DictionaryBuilder) DictionarySize

func (b *Decimal128DictionaryBuilder) DictionarySize() int

func (*Decimal128DictionaryBuilder) IndexBuilder

func (b *Decimal128DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Decimal128DictionaryBuilder) InsertDictValues

func (b *Decimal128DictionaryBuilder) InsertDictValues(arr *Decimal128) (err error)

func (*Decimal128DictionaryBuilder) IsNull

func (b *Decimal128DictionaryBuilder) IsNull(i int) bool

func (*Decimal128DictionaryBuilder) NewArray

func (b *Decimal128DictionaryBuilder) NewArray() arrow.Array

func (*Decimal128DictionaryBuilder) NewDelta

func (b *Decimal128DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Decimal128DictionaryBuilder) NewDictionaryArray

func (b *Decimal128DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Decimal128DictionaryBuilder) Release

func (b *Decimal128DictionaryBuilder) Release()

func (*Decimal128DictionaryBuilder) Reserve

func (b *Decimal128DictionaryBuilder) Reserve(n int)

func (*Decimal128DictionaryBuilder) ResetFull

func (b *Decimal128DictionaryBuilder) ResetFull()

func (*Decimal128DictionaryBuilder) Resize

func (b *Decimal128DictionaryBuilder) Resize(n int)

func (*Decimal128DictionaryBuilder) Type

func (b *Decimal128DictionaryBuilder) Type() arrow.DataType

func (*Decimal128DictionaryBuilder) Unmarshal

func (b *Decimal128DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Decimal128DictionaryBuilder) UnmarshalJSON

func (b *Decimal128DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Decimal128DictionaryBuilder) UnmarshalOne

func (b *Decimal128DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Decimal256

type Decimal256 struct {
	// contains filtered or unexported fields
}

Decimal256 is a type that represents an immutable sequence of 256-bit decimal values.

func NewDecimal256Data

func NewDecimal256Data(data arrow.ArrayData) *Decimal256

func (*Decimal256) Data

func (a *Decimal256) Data() arrow.ArrayData

func (*Decimal256) DataType

func (a *Decimal256) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Decimal256) GetOneForMarshal

func (a *Decimal256) GetOneForMarshal(i int) interface{}

func (*Decimal256) IsNull

func (a *Decimal256) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Decimal256) IsValid

func (a *Decimal256) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Decimal256) Len

func (a *Decimal256) Len() int

Len returns the number of elements in the array.

func (*Decimal256) MarshalJSON

func (a *Decimal256) MarshalJSON() ([]byte, error)

func (*Decimal256) NullBitmapBytes

func (a *Decimal256) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Decimal256) NullN

func (a *Decimal256) NullN() int

NullN returns the number of null values in the array.

func (*Decimal256) Offset

func (a *Decimal256) Offset() int

func (*Decimal256) Release

func (a *Decimal256) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Decimal256) Retain

func (a *Decimal256) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Decimal256) String

func (a *Decimal256) String() string

func (*Decimal256) Value

func (a *Decimal256) Value(i int) decimal256.Num

func (*Decimal256) ValueStr

func (a *Decimal256) ValueStr(i int) string

func (*Decimal256) Values

func (a *Decimal256) Values() []decimal256.Num

type Decimal256Builder

type Decimal256Builder struct {
	// contains filtered or unexported fields
}

func NewDecimal256Builder

func NewDecimal256Builder(mem memory.Allocator, dtype *arrow.Decimal256Type) *Decimal256Builder

func (*Decimal256Builder) Append

func (b *Decimal256Builder) Append(v decimal256.Num)

func (*Decimal256Builder) AppendEmptyValue

func (b *Decimal256Builder) AppendEmptyValue()

func (*Decimal256Builder) AppendEmptyValues

func (b *Decimal256Builder) AppendEmptyValues(n int)

func (*Decimal256Builder) AppendNull

func (b *Decimal256Builder) AppendNull()

func (*Decimal256Builder) AppendNulls

func (b *Decimal256Builder) AppendNulls(n int)

func (*Decimal256Builder) AppendValueFromString

func (b *Decimal256Builder) AppendValueFromString(s string) error

func (*Decimal256Builder) AppendValues

func (b *Decimal256Builder) AppendValues(v []decimal256.Num, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Decimal256Builder) Cap

func (b *Decimal256Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Decimal256Builder) IsNull

func (b *Decimal256Builder) IsNull(i int) bool

func (*Decimal256Builder) Len

func (b *Decimal256Builder) Len() int

Len returns the number of elements in the array builder.

func (*Decimal256Builder) NewArray

func (b *Decimal256Builder) NewArray() arrow.Array

NewArray creates a Decimal256 array from the memory buffers used by the builder and resets the Decimal256Builder so it can be used to build a new array.

func (*Decimal256Builder) NewDecimal256Array

func (b *Decimal256Builder) NewDecimal256Array() (a *Decimal256)

NewDecimal256Array creates a Decimal256 array from the memory buffers used by the builder and resets the Decimal256Builder so it can be used to build a new array.

func (*Decimal256Builder) NullN

func (b *Decimal256Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Decimal256Builder) Release

func (b *Decimal256Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Decimal256Builder) Reserve

func (b *Decimal256Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Decimal256Builder) Resize

func (b *Decimal256Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Decimal256Builder) Retain

func (b *Decimal256Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Decimal256Builder) SetNull

func (b *Decimal256Builder) SetNull(i int)

func (*Decimal256Builder) Type

func (b *Decimal256Builder) Type() arrow.DataType

func (*Decimal256Builder) Unmarshal

func (b *Decimal256Builder) Unmarshal(dec *json.Decoder) error

func (*Decimal256Builder) UnmarshalJSON

func (b *Decimal256Builder) UnmarshalJSON(data []byte) error

UnmarshalJSON will add the unmarshalled values to this builder.

If the values are strings, they will get parsed with big.ParseFloat using a rounding mode of big.ToNearestAway currently.

func (*Decimal256Builder) UnmarshalOne

func (b *Decimal256Builder) UnmarshalOne(dec *json.Decoder) error

func (*Decimal256Builder) UnsafeAppend

func (b *Decimal256Builder) UnsafeAppend(v decimal256.Num)

func (*Decimal256Builder) UnsafeAppendBoolToBitmap

func (b *Decimal256Builder) UnsafeAppendBoolToBitmap(isValid bool)

type Decimal256DictionaryBuilder

type Decimal256DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Decimal256DictionaryBuilder) Append

func (*Decimal256DictionaryBuilder) AppendArray

func (b *Decimal256DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Decimal256DictionaryBuilder) AppendEmptyValue

func (b *Decimal256DictionaryBuilder) AppendEmptyValue()

func (*Decimal256DictionaryBuilder) AppendEmptyValues

func (b *Decimal256DictionaryBuilder) AppendEmptyValues(n int)

func (*Decimal256DictionaryBuilder) AppendIndices

func (b *Decimal256DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Decimal256DictionaryBuilder) AppendNull

func (b *Decimal256DictionaryBuilder) AppendNull()

func (*Decimal256DictionaryBuilder) AppendNulls

func (b *Decimal256DictionaryBuilder) AppendNulls(n int)

func (*Decimal256DictionaryBuilder) AppendValueFromString

func (b *Decimal256DictionaryBuilder) AppendValueFromString(s string) error

func (*Decimal256DictionaryBuilder) Cap

func (b *Decimal256DictionaryBuilder) Cap() int

func (*Decimal256DictionaryBuilder) DictionarySize

func (b *Decimal256DictionaryBuilder) DictionarySize() int

func (*Decimal256DictionaryBuilder) IndexBuilder

func (b *Decimal256DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Decimal256DictionaryBuilder) InsertDictValues

func (b *Decimal256DictionaryBuilder) InsertDictValues(arr *Decimal256) (err error)

func (*Decimal256DictionaryBuilder) IsNull

func (b *Decimal256DictionaryBuilder) IsNull(i int) bool

func (*Decimal256DictionaryBuilder) NewArray

func (b *Decimal256DictionaryBuilder) NewArray() arrow.Array

func (*Decimal256DictionaryBuilder) NewDelta

func (b *Decimal256DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Decimal256DictionaryBuilder) NewDictionaryArray

func (b *Decimal256DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Decimal256DictionaryBuilder) Release

func (b *Decimal256DictionaryBuilder) Release()

func (*Decimal256DictionaryBuilder) Reserve

func (b *Decimal256DictionaryBuilder) Reserve(n int)

func (*Decimal256DictionaryBuilder) ResetFull

func (b *Decimal256DictionaryBuilder) ResetFull()

func (*Decimal256DictionaryBuilder) Resize

func (b *Decimal256DictionaryBuilder) Resize(n int)

func (*Decimal256DictionaryBuilder) Type

func (b *Decimal256DictionaryBuilder) Type() arrow.DataType

func (*Decimal256DictionaryBuilder) Unmarshal

func (b *Decimal256DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Decimal256DictionaryBuilder) UnmarshalJSON

func (b *Decimal256DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Decimal256DictionaryBuilder) UnmarshalOne

func (b *Decimal256DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type DenseUnion

type DenseUnion struct {
	// contains filtered or unexported fields
}

DenseUnion represents an array where each logical value is taken from a single child, at a specific offset. A buffer of 8-bit type ids indicates which child a given logical value is to be taken from and a buffer of 32-bit offsets indicating which physical position in the given child array has the logical value for that index.

Unlike a sparse union, a dense union allows encoding only the child values which are actually referred to by the union array. This is counterbalanced by the additional footprint of the offsets buffer, and the additional indirection cost when looking up values.

Unlike most other arrays, unions do not have a top-level validity bitmap.

func NewDenseUnion

func NewDenseUnion(dt *arrow.DenseUnionType, length int, children []arrow.Array, typeIDs, valueOffsets *memory.Buffer, offset int) *DenseUnion

NewDenseUnion constructs a union array using the given type, length, list of children and buffers of typeIDs and offsets, with the given array offset.

func NewDenseUnionData

func NewDenseUnionData(data arrow.ArrayData) *DenseUnion

NewDenseUnionData constructs a DenseUnion array from the given ArrayData object.

func NewDenseUnionFromArrays

func NewDenseUnionFromArrays(typeIDs, offsets arrow.Array, children []arrow.Array, codes ...arrow.UnionTypeCode) (*DenseUnion, error)

NewDenseUnionFromArrays constructs a new DenseUnion array with the provided values.

typeIDs *must* be an INT8 array with no nulls offsets *must* be an INT32 array with no nulls len(codes) *must* be either 0 or equal to len(children). If len(codes) is 0, the type codes used will be sequentially numeric starting at 0.

func NewDenseUnionFromArraysWithFieldCodes

func NewDenseUnionFromArraysWithFieldCodes(typeIDs, offsets arrow.Array, children []arrow.Array, fields []string, codes []arrow.UnionTypeCode) (*DenseUnion, error)

NewDenseUnionFromArraysWithFieldCodes combines the other constructors for constructing a new DenseUnion array with the provided field names and type codes, along with children and type ids.

All the requirements mentioned in NewDenseUnionFromArrays and NewDenseUnionFromArraysWithFields apply.

func NewDenseUnionFromArraysWithFields

func NewDenseUnionFromArraysWithFields(typeIDs, offsets arrow.Array, children []arrow.Array, fields []string) (*DenseUnion, error)

NewDenseUnionFromArrayWithFields constructs a new DenseUnion array like NewDenseUnionFromArrays, but allows specifying the field names. Type codes will be auto-generated sequentially starting at 0.

typeIDs *must* be an INT8 array with no nulls. offsets *must* be an INT32 array with no nulls. len(fields) *must* either be 0 or equal to len(children). If len(fields) is 0, then the fields will be named sequentially starting at "0".

func (*DenseUnion) ChildID

func (a *DenseUnion) ChildID(i int) int

func (*DenseUnion) Field

func (a *DenseUnion) Field(pos int) (result arrow.Array)

func (*DenseUnion) GetOneForMarshal

func (a *DenseUnion) GetOneForMarshal(i int) interface{}

func (*DenseUnion) MarshalJSON

func (a *DenseUnion) MarshalJSON() ([]byte, error)

func (*DenseUnion) Mode

func (a *DenseUnion) Mode() arrow.UnionMode

func (*DenseUnion) NumFields

func (a *DenseUnion) NumFields() int

func (*DenseUnion) RawTypeCodes

func (a *DenseUnion) RawTypeCodes() []arrow.UnionTypeCode

func (*DenseUnion) RawValueOffsets

func (a *DenseUnion) RawValueOffsets() []int32

func (*DenseUnion) Release

func (a *DenseUnion) Release()

func (*DenseUnion) Retain

func (a *DenseUnion) Retain()

func (*DenseUnion) String

func (a *DenseUnion) String() string

func (*DenseUnion) TypeCode

func (a *DenseUnion) TypeCode(i int) arrow.UnionTypeCode

func (*DenseUnion) TypeCodes

func (a *DenseUnion) TypeCodes() *memory.Buffer

func (*DenseUnion) UnionType

func (a *DenseUnion) UnionType() arrow.UnionType

func (*DenseUnion) Validate

func (a *DenseUnion) Validate() error

func (*DenseUnion) ValidateFull

func (a *DenseUnion) ValidateFull() error

func (*DenseUnion) ValueOffset

func (a *DenseUnion) ValueOffset(i int) int32

func (*DenseUnion) ValueOffsets

func (a *DenseUnion) ValueOffsets() *memory.Buffer

func (*DenseUnion) ValueStr

func (a *DenseUnion) ValueStr(i int) string

type DenseUnionBuilder

type DenseUnionBuilder struct {
	// contains filtered or unexported fields
}

DenseUnionBuilder is used to build a Dense Union array using the Append methods. You can also add new types to the union on the fly by using AppendChild.

func NewDenseUnionBuilder

func NewDenseUnionBuilder(mem memory.Allocator, typ *arrow.DenseUnionType) *DenseUnionBuilder

NewDenseUnionBuilder constructs a new DenseUnionBuilder with the provided children and type codes. Builders will be constructed for each child using the fields in typ

func NewDenseUnionBuilderWithBuilders

func NewDenseUnionBuilderWithBuilders(mem memory.Allocator, typ *arrow.DenseUnionType, children []Builder) *DenseUnionBuilder

NewDenseUnionWithBuilders returns a new DenseUnionBuilder using the provided type and builders.

func NewEmptyDenseUnionBuilder

func NewEmptyDenseUnionBuilder(mem memory.Allocator) *DenseUnionBuilder

NewEmptyDenseUnionBuilder is a helper to construct a DenseUnionBuilder without having to predefine the union types. It creates a builder with no children and AppendChild will have to be called before appending any elements to this builder.

func (*DenseUnionBuilder) Append

func (b *DenseUnionBuilder) Append(nextType arrow.UnionTypeCode)

Append appends the necessary offset and type code to the builder and must be followed up with an append to the appropriate child builder

func (*DenseUnionBuilder) AppendChild

func (b *DenseUnionBuilder) AppendChild(newChild Builder, fieldName string) arrow.UnionTypeCode

func (*DenseUnionBuilder) AppendEmptyValue

func (b *DenseUnionBuilder) AppendEmptyValue()

AppendEmptyValue only appends an empty value arbitrarily to the first child, and then uses that offset to identify the value.

func (*DenseUnionBuilder) AppendEmptyValues

func (b *DenseUnionBuilder) AppendEmptyValues(n int)

AppendEmptyValues, like AppendNulls, will only append a single empty value (implementation defined) to the first child arbitrarily, and then point at that value using the offsets n times. That makes this more efficient than calling AppendEmptyValue multiple times.

func (*DenseUnionBuilder) AppendNull

func (b *DenseUnionBuilder) AppendNull()

AppendNull will only append a null value arbitrarily to the first child and use that offset for this element of the array.

func (*DenseUnionBuilder) AppendNulls

func (b *DenseUnionBuilder) AppendNulls(n int)

AppendNulls will only append a single null arbitrarily to the first child and use the same offset multiple times to point to it. The result is that for a DenseUnion this is more efficient than calling AppendNull multiple times in a loop

func (*DenseUnionBuilder) AppendValueFromString

func (d *DenseUnionBuilder) AppendValueFromString(s string) error

func (*DenseUnionBuilder) Child

func (b *DenseUnionBuilder) Child(idx int) Builder

func (*DenseUnionBuilder) Len

func (b *DenseUnionBuilder) Len() int

Len returns the current number of elements in the builder.

func (*DenseUnionBuilder) Mode

func (b *DenseUnionBuilder) Mode() arrow.UnionMode

func (*DenseUnionBuilder) NewArray

func (b *DenseUnionBuilder) NewArray() arrow.Array

func (*DenseUnionBuilder) NewDenseUnionArray

func (b *DenseUnionBuilder) NewDenseUnionArray() (a *DenseUnion)

func (*DenseUnionBuilder) NumChildren

func (b *DenseUnionBuilder) NumChildren() int

func (*DenseUnionBuilder) Release

func (b *DenseUnionBuilder) Release()

func (*DenseUnionBuilder) Reserve

func (b *DenseUnionBuilder) Reserve(n int)

func (*DenseUnionBuilder) Resize

func (b *DenseUnionBuilder) Resize(n int)

func (*DenseUnionBuilder) Type

func (b *DenseUnionBuilder) Type() arrow.DataType

func (*DenseUnionBuilder) Unmarshal

func (b *DenseUnionBuilder) Unmarshal(dec *json.Decoder) error

func (*DenseUnionBuilder) UnmarshalJSON

func (b *DenseUnionBuilder) UnmarshalJSON(data []byte) (err error)

func (*DenseUnionBuilder) UnmarshalOne

func (b *DenseUnionBuilder) UnmarshalOne(dec *json.Decoder) error

type Dictionary

type Dictionary struct {
	// contains filtered or unexported fields
}

Dictionary represents the type for dictionary-encoded data with a data dependent dictionary.

A dictionary array contains an array of non-negative integers (the "dictionary" indices") along with a data type containing a "dictionary" corresponding to the distinct values represented in the data.

For example, the array:

["foo", "bar", "foo", "bar", "foo", "bar"]

with dictionary ["bar", "foo"], would have the representation of:

indices: [1, 0, 1, 0, 1, 0]
dictionary: ["bar", "foo"]

The indices in principle may be any integer type.

func NewDictionaryArray

func NewDictionaryArray(typ arrow.DataType, indices, dict arrow.Array) *Dictionary

NewDictionaryArray constructs a dictionary array with the provided indices and dictionary using the given type.

func NewDictionaryData

func NewDictionaryData(data arrow.ArrayData) *Dictionary

NewDictionaryData creates a strongly typed Dictionary array from an ArrayData object with a datatype of arrow.Dictionary and a dictionary

func NewValidatedDictionaryArray

func NewValidatedDictionaryArray(typ *arrow.DictionaryType, indices, dict arrow.Array) (*Dictionary, error)

NewValidatedDictionaryArray constructs a dictionary array from the provided indices and dictionary arrays, while also performing validation checks to ensure correctness such as bounds checking at are usually skipped for performance.

func (*Dictionary) CanCompareIndices

func (d *Dictionary) CanCompareIndices(other *Dictionary) bool

CanCompareIndices returns true if the dictionary arrays can be compared without having to unify the dictionaries themselves first. This means that the index types are equal too.

func (*Dictionary) Data

func (a *Dictionary) Data() arrow.ArrayData

func (*Dictionary) DataType

func (a *Dictionary) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Dictionary) Dictionary

func (d *Dictionary) Dictionary() arrow.Array

Dictionary returns the values array that makes up the dictionary for this array.

func (*Dictionary) GetOneForMarshal

func (d *Dictionary) GetOneForMarshal(i int) interface{}

func (*Dictionary) GetValueIndex

func (d *Dictionary) GetValueIndex(i int) int

GetValueIndex returns the dictionary index for the value at index i of the array. The actual value can be retrieved by using d.Dictionary().(valuetype).Value(d.GetValueIndex(i))

func (*Dictionary) Indices

func (d *Dictionary) Indices() arrow.Array

Indices returns the underlying array of indices as it's own array

func (*Dictionary) IsNull

func (a *Dictionary) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Dictionary) IsValid

func (a *Dictionary) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Dictionary) Len

func (a *Dictionary) Len() int

Len returns the number of elements in the array.

func (*Dictionary) MarshalJSON

func (d *Dictionary) MarshalJSON() ([]byte, error)

func (*Dictionary) NullBitmapBytes

func (a *Dictionary) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Dictionary) NullN

func (a *Dictionary) NullN() int

NullN returns the number of null values in the array.

func (*Dictionary) Offset

func (a *Dictionary) Offset() int

func (*Dictionary) Release

func (d *Dictionary) Release()

func (*Dictionary) Retain

func (d *Dictionary) Retain()

func (*Dictionary) String

func (d *Dictionary) String() string

func (*Dictionary) ValueStr

func (d *Dictionary) ValueStr(i int) string

type DictionaryBuilder

type DictionaryBuilder interface {
	Builder

	NewDictionaryArray() *Dictionary
	NewDelta() (indices, delta arrow.Array, err error)
	AppendArray(arrow.Array) error
	AppendIndices([]int, []bool)
	ResetFull()
	DictionarySize() int
}

func NewDictionaryBuilder

func NewDictionaryBuilder(mem memory.Allocator, dt *arrow.DictionaryType) DictionaryBuilder

func NewDictionaryBuilderWithDict

func NewDictionaryBuilderWithDict(mem memory.Allocator, dt *arrow.DictionaryType, init arrow.Array) DictionaryBuilder

NewDictionaryBuilderWithDict initializes a dictionary builder and inserts the values from `init` as the first values in the dictionary, but does not insert them as values into the array.

type DictionaryUnifier

type DictionaryUnifier interface {
	// Unify adds the provided array of dictionary values to be unified.
	Unify(arrow.Array) error
	// UnifyAndTranspose adds the provided array of dictionary values,
	// just like Unify but returns an allocated buffer containing a mapping
	// to transpose dictionary indices.
	UnifyAndTranspose(dict arrow.Array) (transposed *memory.Buffer, err error)
	// GetResult returns the dictionary type (choosing the smallest index type
	// that can represent all the values) and the new unified dictionary.
	//
	// Calling GetResult clears the existing dictionary from the unifier so it
	// can be reused by calling Unify/UnifyAndTranspose again with new arrays.
	GetResult() (outType arrow.DataType, outDict arrow.Array, err error)
	// GetResultWithIndexType is like GetResult, but allows specifying the type
	// of the dictionary indexes rather than letting the unifier pick. If the
	// passed in index type isn't large enough to represent all of the dictionary
	// values, an error will be returned instead. The new unified dictionary
	// is returned.
	GetResultWithIndexType(indexType arrow.DataType) (arrow.Array, error)
	// Release should be called to clean up any allocated scratch memo-table used
	// for building the unified dictionary.
	Release()
}

DictionaryUnifier defines the interface used for unifying, and optionally producing transposition maps for, multiple dictionary arrays incrementally.

func NewBinaryDictionaryUnifier

func NewBinaryDictionaryUnifier(alloc memory.Allocator) DictionaryUnifier

NewBinaryDictionaryUnifier constructs and returns a new dictionary unifier for dictionaries of binary values, using the provided allocator for allocating the unified dictionary and the memotable used for building it.

func NewDictionaryUnifier

func NewDictionaryUnifier(alloc memory.Allocator, valueType arrow.DataType) (DictionaryUnifier, error)

NewDictionaryUnifier constructs and returns a new dictionary unifier for dictionaries of valueType, using the provided allocator for allocating the unified dictionary and the memotable used for building it.

This will only work for non-nested types currently. a nested valueType or dictionary type will result in an error.

type Duration

type Duration struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of arrow.Duration values.

func NewDurationData

func NewDurationData(data arrow.ArrayData) *Duration

NewDurationData creates a new Duration.

func (*Duration) Data

func (a *Duration) Data() arrow.ArrayData

func (*Duration) DataType

func (a *Duration) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Duration) DurationValues

func (a *Duration) DurationValues() []arrow.Duration

Values returns the values.

func (*Duration) GetOneForMarshal

func (a *Duration) GetOneForMarshal(i int) interface{}

func (*Duration) IsNull

func (a *Duration) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Duration) IsValid

func (a *Duration) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Duration) Len

func (a *Duration) Len() int

Len returns the number of elements in the array.

func (*Duration) MarshalJSON

func (a *Duration) MarshalJSON() ([]byte, error)

func (*Duration) NullBitmapBytes

func (a *Duration) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Duration) NullN

func (a *Duration) NullN() int

NullN returns the number of null values in the array.

func (*Duration) Offset

func (a *Duration) Offset() int

func (*Duration) Release

func (a *Duration) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Duration) Reset

func (a *Duration) Reset(data *Data)

Reset resets the array for re-use.

func (*Duration) Retain

func (a *Duration) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Duration) String

func (a *Duration) String() string

String returns a string representation of the array.

func (*Duration) Value

func (a *Duration) Value(i int) arrow.Duration

Value returns the value at the specified index.

func (*Duration) ValueStr

func (a *Duration) ValueStr(i int) string

type DurationBuilder

type DurationBuilder struct {
	// contains filtered or unexported fields
}

func NewDurationBuilder

func NewDurationBuilder(mem memory.Allocator, dtype *arrow.DurationType) *DurationBuilder

func (*DurationBuilder) Append

func (b *DurationBuilder) Append(v arrow.Duration)

func (*DurationBuilder) AppendEmptyValue

func (b *DurationBuilder) AppendEmptyValue()

func (*DurationBuilder) AppendEmptyValues

func (b *DurationBuilder) AppendEmptyValues(n int)

func (*DurationBuilder) AppendNull

func (b *DurationBuilder) AppendNull()

func (*DurationBuilder) AppendNulls

func (b *DurationBuilder) AppendNulls(n int)

func (*DurationBuilder) AppendValueFromString

func (b *DurationBuilder) AppendValueFromString(s string) error

func (*DurationBuilder) AppendValues

func (b *DurationBuilder) AppendValues(v []arrow.Duration, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*DurationBuilder) Cap

func (b *DurationBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*DurationBuilder) IsNull

func (b *DurationBuilder) IsNull(i int) bool

func (*DurationBuilder) Len

func (b *DurationBuilder) Len() int

Len returns the number of elements in the array builder.

func (*DurationBuilder) NewArray

func (b *DurationBuilder) NewArray() arrow.Array

NewArray creates a Duration array from the memory buffers used by the builder and resets the DurationBuilder so it can be used to build a new array.

func (*DurationBuilder) NewDurationArray

func (b *DurationBuilder) NewDurationArray() (a *Duration)

NewDurationArray creates a Duration array from the memory buffers used by the builder and resets the DurationBuilder so it can be used to build a new array.

func (*DurationBuilder) NullN

func (b *DurationBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*DurationBuilder) Release

func (b *DurationBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*DurationBuilder) Reserve

func (b *DurationBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*DurationBuilder) Resize

func (b *DurationBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*DurationBuilder) Retain

func (b *DurationBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*DurationBuilder) SetNull

func (b *DurationBuilder) SetNull(i int)

func (*DurationBuilder) Type

func (b *DurationBuilder) Type() arrow.DataType

func (*DurationBuilder) Unmarshal

func (b *DurationBuilder) Unmarshal(dec *json.Decoder) error

func (*DurationBuilder) UnmarshalJSON

func (b *DurationBuilder) UnmarshalJSON(data []byte) error

func (*DurationBuilder) UnmarshalOne

func (b *DurationBuilder) UnmarshalOne(dec *json.Decoder) error

func (*DurationBuilder) UnsafeAppend

func (b *DurationBuilder) UnsafeAppend(v arrow.Duration)

func (*DurationBuilder) UnsafeAppendBoolToBitmap

func (b *DurationBuilder) UnsafeAppendBoolToBitmap(isValid bool)

func (*DurationBuilder) Value

func (b *DurationBuilder) Value(i int) arrow.Duration

type DurationDictionaryBuilder

type DurationDictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*DurationDictionaryBuilder) Append

func (*DurationDictionaryBuilder) AppendArray

func (b *DurationDictionaryBuilder) AppendArray(arr arrow.Array) error

func (*DurationDictionaryBuilder) AppendEmptyValue

func (b *DurationDictionaryBuilder) AppendEmptyValue()

func (*DurationDictionaryBuilder) AppendEmptyValues

func (b *DurationDictionaryBuilder) AppendEmptyValues(n int)

func (*DurationDictionaryBuilder) AppendIndices

func (b *DurationDictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*DurationDictionaryBuilder) AppendNull

func (b *DurationDictionaryBuilder) AppendNull()

func (*DurationDictionaryBuilder) AppendNulls

func (b *DurationDictionaryBuilder) AppendNulls(n int)

func (*DurationDictionaryBuilder) AppendValueFromString

func (b *DurationDictionaryBuilder) AppendValueFromString(s string) error

func (*DurationDictionaryBuilder) Cap

func (b *DurationDictionaryBuilder) Cap() int

func (*DurationDictionaryBuilder) DictionarySize

func (b *DurationDictionaryBuilder) DictionarySize() int

func (*DurationDictionaryBuilder) IndexBuilder

func (b *DurationDictionaryBuilder) IndexBuilder() IndexBuilder

func (*DurationDictionaryBuilder) InsertDictValues

func (b *DurationDictionaryBuilder) InsertDictValues(arr *Duration) (err error)

func (*DurationDictionaryBuilder) IsNull

func (b *DurationDictionaryBuilder) IsNull(i int) bool

func (*DurationDictionaryBuilder) NewArray

func (b *DurationDictionaryBuilder) NewArray() arrow.Array

func (*DurationDictionaryBuilder) NewDelta

func (b *DurationDictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*DurationDictionaryBuilder) NewDictionaryArray

func (b *DurationDictionaryBuilder) NewDictionaryArray() *Dictionary

func (*DurationDictionaryBuilder) Release

func (b *DurationDictionaryBuilder) Release()

func (*DurationDictionaryBuilder) Reserve

func (b *DurationDictionaryBuilder) Reserve(n int)

func (*DurationDictionaryBuilder) ResetFull

func (b *DurationDictionaryBuilder) ResetFull()

func (*DurationDictionaryBuilder) Resize

func (b *DurationDictionaryBuilder) Resize(n int)

func (*DurationDictionaryBuilder) Type

func (b *DurationDictionaryBuilder) Type() arrow.DataType

func (*DurationDictionaryBuilder) Unmarshal

func (b *DurationDictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*DurationDictionaryBuilder) UnmarshalJSON

func (b *DurationDictionaryBuilder) UnmarshalJSON(data []byte) error

func (*DurationDictionaryBuilder) UnmarshalOne

func (b *DurationDictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Edit

type Edit struct {
	Insert    bool
	RunLength int64
}

Edit represents one entry in the edit script to compare two arrays.

type Edits

type Edits []Edit

Edits is a slice of Edit structs that represents an edit script to compare two arrays. When applied to the base array, it produces the target array. Each element of "insert" determines whether an element was inserted into (true) or deleted from (false) base. Each insertion or deletion is followed by a run of elements which are unchanged from base to target; the length of this run is stored in RunLength. (Note that the edit script begins and ends with a run of shared elements but both fields of the struct must have the same length. To accommodate this the first element of "insert" should be ignored.)

For example for base "hlloo" and target "hello", the edit script would be [

{"insert": false, "run_length": 1}, // leading run of length 1 ("h")
{"insert": true, "run_length": 3}, // insert("e") then a run of length 3 ("llo")
{"insert": false, "run_length": 0} // delete("o") then an empty run

]

func Diff

func Diff(base, target arrow.Array) (edits Edits, err error)

Diff compares two arrays, returning an edit script which expresses the difference between them. The edit script can be applied to the base array to produce the target. 'base' is a baseline for comparison. 'target' is an array of identical type to base whose elements differ from base's.

func (Edits) String

func (e Edits) String() string

String returns a simple string representation of the edit script.

func (Edits) UnifiedDiff

func (e Edits) UnifiedDiff(base, target arrow.Array) string

UnifiedDiff returns a string representation of the diff of base and target in Unified Diff format.

type EqualOption

type EqualOption func(*equalOption)

EqualOption is a functional option type used to configure how Records and Arrays are compared.

func WithAbsTolerance

func WithAbsTolerance(atol float64) EqualOption

WithAbsTolerance configures the comparison functions so that 2 floating point values v1 and v2 are considered equal if |v1-v2| <= atol.

func WithNaNsEqual

func WithNaNsEqual(v bool) EqualOption

WithNaNsEqual configures the comparison functions so that NaNs are considered equal.

func WithUnorderedMapKeys

func WithUnorderedMapKeys(v bool) EqualOption

WithUnorderedMapKeys configures the comparison functions so that Map with different entries order are considered equal.

type ExtensionArray

type ExtensionArray interface {
	arrow.Array
	// ExtensionType returns the datatype as per calling DataType(), but
	// already cast to ExtensionType
	ExtensionType() arrow.ExtensionType
	// Storage returns the underlying storage array for this array.
	Storage() arrow.Array
	// contains filtered or unexported methods
}

ExtensionArray is the interface that needs to be implemented to handle user-defined extension type arrays. In order to ensure consistency and proper behavior, all ExtensionArray types must embed ExtensionArrayBase in order to meet the interface which provides the default implementation and handling for the array while allowing custom behavior to be built on top of it.

func NewExtensionData

func NewExtensionData(data arrow.ArrayData) ExtensionArray

NewExtensionData expects a data with a datatype of arrow.ExtensionType and underlying data built for the storage array.

type ExtensionArrayBase

type ExtensionArrayBase struct {
	// contains filtered or unexported fields
}

ExtensionArrayBase is the base struct for user-defined Extension Array types and must be embedded in any user-defined extension arrays like so:

type UserDefinedArray struct {
    array.ExtensionArrayBase
}

func (*ExtensionArrayBase) Data

func (a *ExtensionArrayBase) Data() arrow.ArrayData

func (*ExtensionArrayBase) DataType

func (a *ExtensionArrayBase) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*ExtensionArrayBase) ExtensionType

func (e *ExtensionArrayBase) ExtensionType() arrow.ExtensionType

ExtensionType returns the same thing as DataType, just already casted to an ExtensionType interface for convenience.

func (*ExtensionArrayBase) GetOneForMarshal

func (e *ExtensionArrayBase) GetOneForMarshal(i int) interface{}

func (*ExtensionArrayBase) IsNull

func (a *ExtensionArrayBase) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*ExtensionArrayBase) IsValid

func (a *ExtensionArrayBase) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*ExtensionArrayBase) Len

func (a *ExtensionArrayBase) Len() int

Len returns the number of elements in the array.

func (*ExtensionArrayBase) MarshalJSON

func (e *ExtensionArrayBase) MarshalJSON() ([]byte, error)

func (*ExtensionArrayBase) NullBitmapBytes

func (a *ExtensionArrayBase) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*ExtensionArrayBase) NullN

func (a *ExtensionArrayBase) NullN() int

NullN returns the number of null values in the array.

func (*ExtensionArrayBase) Offset

func (a *ExtensionArrayBase) Offset() int

func (*ExtensionArrayBase) Release

func (e *ExtensionArrayBase) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*ExtensionArrayBase) Retain

func (e *ExtensionArrayBase) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*ExtensionArrayBase) Storage

func (e *ExtensionArrayBase) Storage() arrow.Array

Storage returns the underlying storage array

func (*ExtensionArrayBase) String

func (e *ExtensionArrayBase) String() string

func (*ExtensionArrayBase) ValueStr

func (e *ExtensionArrayBase) ValueStr(i int) string

ValueStr returns the value at index i as a string. This needs to be implemented by the extension array type.

type ExtensionBuilder

type ExtensionBuilder struct {
	Builder
	// contains filtered or unexported fields
}

ExtensionBuilder is a convenience builder so that NewBuilder and such will still work with extension types properly. Depending on preference it may be cleaner or easier to just use NewExtensionArrayWithStorage and pass a storage array.

That said, this allows easily building an extension array by providing the extension type and retrieving the storage builder.

func NewExtensionBuilder

func NewExtensionBuilder(mem memory.Allocator, dt arrow.ExtensionType) *ExtensionBuilder

NewExtensionBuilder returns a builder using the provided memory allocator for the desired extension type. It will internally construct a builder of the storage type for the extension type and keep a copy of the extension type. The underlying type builder can then be retrieved by calling `StorageBuilder` on this and then type asserting it to the desired builder type.

After using the storage builder, calling NewArray or NewExtensionArray will construct the appropriate extension array type and set the storage correctly, resetting the builder for reuse.

Example

Simple example assuming an extension type of a UUID defined as a FixedSizeBinary(16) was registered using the type name "uuid":

uuidType := arrow.GetExtensionType("uuid")
bldr := array.NewExtensionBuilder(memory.DefaultAllocator, uuidType)
defer bldr.Release()
uuidBldr := bldr.StorageBuilder().(*array.FixedSizeBinaryBuilder)
/* build up the fixed size binary array as usual via Append/AppendValues */
uuidArr := bldr.NewExtensionArray()
defer uuidArr.Release()

Because the storage builder is embedded in the Extension builder it also means that any of the functions available on the Builder interface can be called on an instance of ExtensionBuilder and will respond appropriately as the storage builder would for generically grabbing the Lenth, Cap, Nulls, reserving, etc.

func (*ExtensionBuilder) NewArray

func (b *ExtensionBuilder) NewArray() arrow.Array

NewArray creates a new array from the memory buffers used by the builder and resets the builder so it can be used to build a new array.

func (*ExtensionBuilder) NewExtensionArray

func (b *ExtensionBuilder) NewExtensionArray() ExtensionArray

NewExtensionArray creates an Extension array from the memory buffers used by the builder and resets the ExtensionBuilder so it can be used to build a new ExtensionArray of the same type.

func (*ExtensionBuilder) StorageBuilder

func (b *ExtensionBuilder) StorageBuilder() Builder

StorageBuilder returns the builder for the underlying storage type.

func (*ExtensionBuilder) Type

func (b *ExtensionBuilder) Type() arrow.DataType

type ExtensionBuilderWrapper

type ExtensionBuilderWrapper interface {
	NewBuilder(bldr *ExtensionBuilder) Builder
}

ExtensionBuilderWrapper is an interface that you need to implement in your custom extension type if you want to provide a customer builder as well. See example in ./arrow/internal/testing/types/extension_types.go

type FixedSizeBinary

type FixedSizeBinary struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of fixed-length binary strings.

func NewFixedSizeBinaryData

func NewFixedSizeBinaryData(data arrow.ArrayData) *FixedSizeBinary

NewFixedSizeBinaryData constructs a new fixed-size binary array from data.

func (*FixedSizeBinary) Data

func (a *FixedSizeBinary) Data() arrow.ArrayData

func (*FixedSizeBinary) DataType

func (a *FixedSizeBinary) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*FixedSizeBinary) GetOneForMarshal

func (a *FixedSizeBinary) GetOneForMarshal(i int) interface{}

func (*FixedSizeBinary) IsNull

func (a *FixedSizeBinary) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*FixedSizeBinary) IsValid

func (a *FixedSizeBinary) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*FixedSizeBinary) Len

func (a *FixedSizeBinary) Len() int

Len returns the number of elements in the array.

func (*FixedSizeBinary) MarshalJSON

func (a *FixedSizeBinary) MarshalJSON() ([]byte, error)

func (*FixedSizeBinary) NullBitmapBytes

func (a *FixedSizeBinary) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*FixedSizeBinary) NullN

func (a *FixedSizeBinary) NullN() int

NullN returns the number of null values in the array.

func (*FixedSizeBinary) Offset

func (a *FixedSizeBinary) Offset() int

func (*FixedSizeBinary) Release

func (a *FixedSizeBinary) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*FixedSizeBinary) Retain

func (a *FixedSizeBinary) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*FixedSizeBinary) String

func (a *FixedSizeBinary) String() string

func (*FixedSizeBinary) Value

func (a *FixedSizeBinary) Value(i int) []byte

Value returns the fixed-size slice at index i. This value should not be mutated.

func (*FixedSizeBinary) ValueStr

func (a *FixedSizeBinary) ValueStr(i int) string

type FixedSizeBinaryBuilder

type FixedSizeBinaryBuilder struct {
	// contains filtered or unexported fields
}

A FixedSizeBinaryBuilder is used to build a FixedSizeBinary array using the Append methods.

func (*FixedSizeBinaryBuilder) Append

func (b *FixedSizeBinaryBuilder) Append(v []byte)

func (*FixedSizeBinaryBuilder) AppendEmptyValue

func (b *FixedSizeBinaryBuilder) AppendEmptyValue()

func (*FixedSizeBinaryBuilder) AppendEmptyValues

func (b *FixedSizeBinaryBuilder) AppendEmptyValues(n int)

func (*FixedSizeBinaryBuilder) AppendNull

func (b *FixedSizeBinaryBuilder) AppendNull()

func (*FixedSizeBinaryBuilder) AppendNulls

func (b *FixedSizeBinaryBuilder) AppendNulls(n int)

func (*FixedSizeBinaryBuilder) AppendValueFromString

func (b *FixedSizeBinaryBuilder) AppendValueFromString(s string) error

func (*FixedSizeBinaryBuilder) AppendValues

func (b *FixedSizeBinaryBuilder) AppendValues(v [][]byte, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*FixedSizeBinaryBuilder) Cap

func (b *FixedSizeBinaryBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*FixedSizeBinaryBuilder) IsNull

func (b *FixedSizeBinaryBuilder) IsNull(i int) bool

func (*FixedSizeBinaryBuilder) Len

func (b *FixedSizeBinaryBuilder) Len() int

Len returns the number of elements in the array builder.

func (*FixedSizeBinaryBuilder) NewArray

func (b *FixedSizeBinaryBuilder) NewArray() arrow.Array

NewArray creates a FixedSizeBinary array from the memory buffers used by the builder and resets the FixedSizeBinaryBuilder so it can be used to build a new array.

func (*FixedSizeBinaryBuilder) NewFixedSizeBinaryArray

func (b *FixedSizeBinaryBuilder) NewFixedSizeBinaryArray() (a *FixedSizeBinary)

NewFixedSizeBinaryArray creates a FixedSizeBinary array from the memory buffers used by the builder and resets the FixedSizeBinaryBuilder so it can be used to build a new array.

func (*FixedSizeBinaryBuilder) NullN

func (b *FixedSizeBinaryBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*FixedSizeBinaryBuilder) Release

func (b *FixedSizeBinaryBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed. Release may be called simultaneously from multiple goroutines.

func (*FixedSizeBinaryBuilder) Reserve

func (b *FixedSizeBinaryBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*FixedSizeBinaryBuilder) Resize

func (b *FixedSizeBinaryBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*FixedSizeBinaryBuilder) Retain

func (b *FixedSizeBinaryBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*FixedSizeBinaryBuilder) SetNull

func (b *FixedSizeBinaryBuilder) SetNull(i int)

func (*FixedSizeBinaryBuilder) Type

func (*FixedSizeBinaryBuilder) Unmarshal

func (b *FixedSizeBinaryBuilder) Unmarshal(dec *json.Decoder) error

func (*FixedSizeBinaryBuilder) UnmarshalJSON

func (b *FixedSizeBinaryBuilder) UnmarshalJSON(data []byte) error

func (*FixedSizeBinaryBuilder) UnmarshalOne

func (b *FixedSizeBinaryBuilder) UnmarshalOne(dec *json.Decoder) error

func (*FixedSizeBinaryBuilder) UnsafeAppend

func (b *FixedSizeBinaryBuilder) UnsafeAppend(v []byte)

func (*FixedSizeBinaryBuilder) UnsafeAppendBoolToBitmap

func (b *FixedSizeBinaryBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type FixedSizeBinaryDictionaryBuilder

type FixedSizeBinaryDictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*FixedSizeBinaryDictionaryBuilder) Append

func (*FixedSizeBinaryDictionaryBuilder) AppendArray

func (b *FixedSizeBinaryDictionaryBuilder) AppendArray(arr arrow.Array) error

func (*FixedSizeBinaryDictionaryBuilder) AppendEmptyValue

func (b *FixedSizeBinaryDictionaryBuilder) AppendEmptyValue()

func (*FixedSizeBinaryDictionaryBuilder) AppendEmptyValues

func (b *FixedSizeBinaryDictionaryBuilder) AppendEmptyValues(n int)

func (*FixedSizeBinaryDictionaryBuilder) AppendIndices

func (b *FixedSizeBinaryDictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*FixedSizeBinaryDictionaryBuilder) AppendNull

func (b *FixedSizeBinaryDictionaryBuilder) AppendNull()

func (*FixedSizeBinaryDictionaryBuilder) AppendNulls

func (b *FixedSizeBinaryDictionaryBuilder) AppendNulls(n int)

func (*FixedSizeBinaryDictionaryBuilder) AppendValueFromString

func (b *FixedSizeBinaryDictionaryBuilder) AppendValueFromString(s string) error

func (*FixedSizeBinaryDictionaryBuilder) Cap

func (b *FixedSizeBinaryDictionaryBuilder) Cap() int

func (*FixedSizeBinaryDictionaryBuilder) DictionarySize

func (b *FixedSizeBinaryDictionaryBuilder) DictionarySize() int

func (*FixedSizeBinaryDictionaryBuilder) IndexBuilder

func (b *FixedSizeBinaryDictionaryBuilder) IndexBuilder() IndexBuilder

func (*FixedSizeBinaryDictionaryBuilder) InsertDictValues

func (b *FixedSizeBinaryDictionaryBuilder) InsertDictValues(arr *FixedSizeBinary) (err error)

func (*FixedSizeBinaryDictionaryBuilder) IsNull

func (b *FixedSizeBinaryDictionaryBuilder) IsNull(i int) bool

func (*FixedSizeBinaryDictionaryBuilder) NewArray

func (b *FixedSizeBinaryDictionaryBuilder) NewArray() arrow.Array

func (*FixedSizeBinaryDictionaryBuilder) NewDelta

func (b *FixedSizeBinaryDictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*FixedSizeBinaryDictionaryBuilder) NewDictionaryArray

func (b *FixedSizeBinaryDictionaryBuilder) NewDictionaryArray() *Dictionary

func (*FixedSizeBinaryDictionaryBuilder) Release

func (b *FixedSizeBinaryDictionaryBuilder) Release()

func (*FixedSizeBinaryDictionaryBuilder) Reserve

func (b *FixedSizeBinaryDictionaryBuilder) Reserve(n int)

func (*FixedSizeBinaryDictionaryBuilder) ResetFull

func (b *FixedSizeBinaryDictionaryBuilder) ResetFull()

func (*FixedSizeBinaryDictionaryBuilder) Resize

func (b *FixedSizeBinaryDictionaryBuilder) Resize(n int)

func (*FixedSizeBinaryDictionaryBuilder) Type

func (b *FixedSizeBinaryDictionaryBuilder) Type() arrow.DataType

func (*FixedSizeBinaryDictionaryBuilder) Unmarshal

func (b *FixedSizeBinaryDictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*FixedSizeBinaryDictionaryBuilder) UnmarshalJSON

func (b *FixedSizeBinaryDictionaryBuilder) UnmarshalJSON(data []byte) error

func (*FixedSizeBinaryDictionaryBuilder) UnmarshalOne

func (b *FixedSizeBinaryDictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type FixedSizeList

type FixedSizeList struct {
	// contains filtered or unexported fields
}

FixedSizeList represents an immutable sequence of N array values.

func NewFixedSizeListData

func NewFixedSizeListData(data arrow.ArrayData) *FixedSizeList

NewFixedSizeListData returns a new List array value, from data.

func (*FixedSizeList) Data

func (a *FixedSizeList) Data() arrow.ArrayData

func (*FixedSizeList) DataType

func (a *FixedSizeList) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*FixedSizeList) GetOneForMarshal

func (a *FixedSizeList) GetOneForMarshal(i int) interface{}

func (*FixedSizeList) IsNull

func (a *FixedSizeList) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*FixedSizeList) IsValid

func (a *FixedSizeList) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*FixedSizeList) Len

func (a *FixedSizeList) Len() int

Len returns the number of elements in the array.

func (*FixedSizeList) ListValues

func (a *FixedSizeList) ListValues() arrow.Array

func (*FixedSizeList) MarshalJSON

func (a *FixedSizeList) MarshalJSON() ([]byte, error)

func (*FixedSizeList) NullBitmapBytes

func (a *FixedSizeList) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*FixedSizeList) NullN

func (a *FixedSizeList) NullN() int

NullN returns the number of null values in the array.

func (*FixedSizeList) Offset

func (a *FixedSizeList) Offset() int

func (*FixedSizeList) Release

func (a *FixedSizeList) Release()

func (*FixedSizeList) Retain

func (a *FixedSizeList) Retain()

func (*FixedSizeList) String

func (a *FixedSizeList) String() string

func (*FixedSizeList) ValueOffsets

func (a *FixedSizeList) ValueOffsets(i int) (start, end int64)

func (*FixedSizeList) ValueStr

func (a *FixedSizeList) ValueStr(i int) string

type FixedSizeListBuilder

type FixedSizeListBuilder struct {
	// contains filtered or unexported fields
}

func NewFixedSizeListBuilder

func NewFixedSizeListBuilder(mem memory.Allocator, n int32, etype arrow.DataType) *FixedSizeListBuilder

NewFixedSizeListBuilder returns a builder, using the provided memory allocator. The created list builder will create a list whose elements will be of type etype.

func (*FixedSizeListBuilder) Append

func (b *FixedSizeListBuilder) Append(v bool)

func (*FixedSizeListBuilder) AppendEmptyValue

func (b *FixedSizeListBuilder) AppendEmptyValue()

func (*FixedSizeListBuilder) AppendEmptyValues

func (b *FixedSizeListBuilder) AppendEmptyValues(n int)

func (*FixedSizeListBuilder) AppendNull

func (b *FixedSizeListBuilder) AppendNull()

AppendNull will append null values to the underlying values by itself

func (*FixedSizeListBuilder) AppendNulls

func (b *FixedSizeListBuilder) AppendNulls(n int)

AppendNulls will append n null values to the underlying values by itself

func (*FixedSizeListBuilder) AppendValueFromString

func (b *FixedSizeListBuilder) AppendValueFromString(s string) error

func (*FixedSizeListBuilder) AppendValues

func (b *FixedSizeListBuilder) AppendValues(valid []bool)

func (*FixedSizeListBuilder) Cap

func (b *FixedSizeListBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*FixedSizeListBuilder) IsNull

func (b *FixedSizeListBuilder) IsNull(i int) bool

func (*FixedSizeListBuilder) Len

func (b *FixedSizeListBuilder) Len() int

Len returns the number of elements in the array builder.

func (*FixedSizeListBuilder) NewArray

func (b *FixedSizeListBuilder) NewArray() arrow.Array

NewArray creates a List array from the memory buffers used by the builder and resets the FixedSizeListBuilder so it can be used to build a new array.

func (*FixedSizeListBuilder) NewListArray

func (b *FixedSizeListBuilder) NewListArray() (a *FixedSizeList)

NewListArray creates a List array from the memory buffers used by the builder and resets the FixedSizeListBuilder so it can be used to build a new array.

func (*FixedSizeListBuilder) NullN

func (b *FixedSizeListBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*FixedSizeListBuilder) Release

func (b *FixedSizeListBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*FixedSizeListBuilder) Reserve

func (b *FixedSizeListBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*FixedSizeListBuilder) Resize

func (b *FixedSizeListBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*FixedSizeListBuilder) Retain

func (b *FixedSizeListBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*FixedSizeListBuilder) SetNull

func (b *FixedSizeListBuilder) SetNull(i int)

func (*FixedSizeListBuilder) Type

func (*FixedSizeListBuilder) Unmarshal

func (b *FixedSizeListBuilder) Unmarshal(dec *json.Decoder) error

func (*FixedSizeListBuilder) UnmarshalJSON

func (b *FixedSizeListBuilder) UnmarshalJSON(data []byte) error

func (*FixedSizeListBuilder) UnmarshalOne

func (b *FixedSizeListBuilder) UnmarshalOne(dec *json.Decoder) error

func (*FixedSizeListBuilder) UnsafeAppendBoolToBitmap

func (b *FixedSizeListBuilder) UnsafeAppendBoolToBitmap(isValid bool)

func (*FixedSizeListBuilder) ValueBuilder

func (b *FixedSizeListBuilder) ValueBuilder() Builder

type Float16

type Float16 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of Float16 values.

func NewFloat16Data

func NewFloat16Data(data arrow.ArrayData) *Float16

func (*Float16) Data

func (a *Float16) Data() arrow.ArrayData

func (*Float16) DataType

func (a *Float16) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Float16) GetOneForMarshal

func (a *Float16) GetOneForMarshal(i int) interface{}

func (*Float16) IsNull

func (a *Float16) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Float16) IsValid

func (a *Float16) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Float16) Len

func (a *Float16) Len() int

Len returns the number of elements in the array.

func (*Float16) MarshalJSON

func (a *Float16) MarshalJSON() ([]byte, error)

func (*Float16) NullBitmapBytes

func (a *Float16) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Float16) NullN

func (a *Float16) NullN() int

NullN returns the number of null values in the array.

func (*Float16) Offset

func (a *Float16) Offset() int

func (*Float16) Release

func (a *Float16) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Float16) Retain

func (a *Float16) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Float16) String

func (a *Float16) String() string

func (*Float16) Value

func (a *Float16) Value(i int) float16.Num

func (*Float16) ValueStr

func (a *Float16) ValueStr(i int) string

func (*Float16) Values

func (a *Float16) Values() []float16.Num

type Float16Builder

type Float16Builder struct {
	// contains filtered or unexported fields
}

func NewFloat16Builder

func NewFloat16Builder(mem memory.Allocator) *Float16Builder

func (*Float16Builder) Append

func (b *Float16Builder) Append(v float16.Num)

func (*Float16Builder) AppendEmptyValue

func (b *Float16Builder) AppendEmptyValue()

func (*Float16Builder) AppendEmptyValues

func (b *Float16Builder) AppendEmptyValues(n int)

func (*Float16Builder) AppendNull

func (b *Float16Builder) AppendNull()

func (*Float16Builder) AppendNulls

func (b *Float16Builder) AppendNulls(n int)

func (*Float16Builder) AppendValueFromString

func (b *Float16Builder) AppendValueFromString(s string) error

func (*Float16Builder) AppendValues

func (b *Float16Builder) AppendValues(v []float16.Num, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Float16Builder) Cap

func (b *Float16Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Float16Builder) IsNull

func (b *Float16Builder) IsNull(i int) bool

func (*Float16Builder) Len

func (b *Float16Builder) Len() int

Len returns the number of elements in the array builder.

func (*Float16Builder) NewArray

func (b *Float16Builder) NewArray() arrow.Array

NewArray creates a Float16 array from the memory buffers used by the builder and resets the Float16Builder so it can be used to build a new array.

func (*Float16Builder) NewFloat16Array

func (b *Float16Builder) NewFloat16Array() (a *Float16)

NewFloat16Array creates a Float16 array from the memory buffers used by the builder and resets the Float16Builder so it can be used to build a new array.

func (*Float16Builder) NullN

func (b *Float16Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Float16Builder) Release

func (b *Float16Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Float16Builder) Reserve

func (b *Float16Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Float16Builder) Resize

func (b *Float16Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Float16Builder) Retain

func (b *Float16Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Float16Builder) SetNull

func (b *Float16Builder) SetNull(i int)

func (*Float16Builder) Type

func (b *Float16Builder) Type() arrow.DataType

func (*Float16Builder) Unmarshal

func (b *Float16Builder) Unmarshal(dec *json.Decoder) error

func (*Float16Builder) UnmarshalJSON

func (b *Float16Builder) UnmarshalJSON(data []byte) error

UnmarshalJSON will add values to this builder from unmarshalling the array of values. Currently values that are larger than a float16 will be silently truncated.

func (*Float16Builder) UnmarshalOne

func (b *Float16Builder) UnmarshalOne(dec *json.Decoder) error

func (*Float16Builder) UnsafeAppend

func (b *Float16Builder) UnsafeAppend(v float16.Num)

func (*Float16Builder) UnsafeAppendBoolToBitmap

func (b *Float16Builder) UnsafeAppendBoolToBitmap(isValid bool)

type Float16DictionaryBuilder

type Float16DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Float16DictionaryBuilder) Append

func (*Float16DictionaryBuilder) AppendArray

func (b *Float16DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Float16DictionaryBuilder) AppendEmptyValue

func (b *Float16DictionaryBuilder) AppendEmptyValue()

func (*Float16DictionaryBuilder) AppendEmptyValues

func (b *Float16DictionaryBuilder) AppendEmptyValues(n int)

func (*Float16DictionaryBuilder) AppendIndices

func (b *Float16DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Float16DictionaryBuilder) AppendNull

func (b *Float16DictionaryBuilder) AppendNull()

func (*Float16DictionaryBuilder) AppendNulls

func (b *Float16DictionaryBuilder) AppendNulls(n int)

func (*Float16DictionaryBuilder) AppendValueFromString

func (b *Float16DictionaryBuilder) AppendValueFromString(s string) error

func (*Float16DictionaryBuilder) Cap

func (b *Float16DictionaryBuilder) Cap() int

func (*Float16DictionaryBuilder) DictionarySize

func (b *Float16DictionaryBuilder) DictionarySize() int

func (*Float16DictionaryBuilder) IndexBuilder

func (b *Float16DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Float16DictionaryBuilder) InsertDictValues

func (b *Float16DictionaryBuilder) InsertDictValues(arr *Float16) (err error)

func (*Float16DictionaryBuilder) IsNull

func (b *Float16DictionaryBuilder) IsNull(i int) bool

func (*Float16DictionaryBuilder) NewArray

func (b *Float16DictionaryBuilder) NewArray() arrow.Array

func (*Float16DictionaryBuilder) NewDelta

func (b *Float16DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Float16DictionaryBuilder) NewDictionaryArray

func (b *Float16DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Float16DictionaryBuilder) Release

func (b *Float16DictionaryBuilder) Release()

func (*Float16DictionaryBuilder) Reserve

func (b *Float16DictionaryBuilder) Reserve(n int)

func (*Float16DictionaryBuilder) ResetFull

func (b *Float16DictionaryBuilder) ResetFull()

func (*Float16DictionaryBuilder) Resize

func (b *Float16DictionaryBuilder) Resize(n int)

func (*Float16DictionaryBuilder) Type

func (b *Float16DictionaryBuilder) Type() arrow.DataType

func (*Float16DictionaryBuilder) Unmarshal

func (b *Float16DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Float16DictionaryBuilder) UnmarshalJSON

func (b *Float16DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Float16DictionaryBuilder) UnmarshalOne

func (b *Float16DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Float32

type Float32 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of float32 values.

func NewFloat32Data

func NewFloat32Data(data arrow.ArrayData) *Float32

NewFloat32Data creates a new Float32.

func (*Float32) Data

func (a *Float32) Data() arrow.ArrayData

func (*Float32) DataType

func (a *Float32) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Float32) Float32Values

func (a *Float32) Float32Values() []float32

Values returns the values.

func (*Float32) GetOneForMarshal

func (a *Float32) GetOneForMarshal(i int) interface{}

func (*Float32) IsNull

func (a *Float32) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Float32) IsValid

func (a *Float32) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Float32) Len

func (a *Float32) Len() int

Len returns the number of elements in the array.

func (*Float32) MarshalJSON

func (a *Float32) MarshalJSON() ([]byte, error)

func (*Float32) NullBitmapBytes

func (a *Float32) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Float32) NullN

func (a *Float32) NullN() int

NullN returns the number of null values in the array.

func (*Float32) Offset

func (a *Float32) Offset() int

func (*Float32) Release

func (a *Float32) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Float32) Reset

func (a *Float32) Reset(data *Data)

Reset resets the array for re-use.

func (*Float32) Retain

func (a *Float32) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Float32) String

func (a *Float32) String() string

String returns a string representation of the array.

func (*Float32) Value

func (a *Float32) Value(i int) float32

Value returns the value at the specified index.

func (*Float32) ValueStr

func (a *Float32) ValueStr(i int) string

type Float32Builder

type Float32Builder struct {
	// contains filtered or unexported fields
}

func NewFloat32Builder

func NewFloat32Builder(mem memory.Allocator) *Float32Builder

func (*Float32Builder) Append

func (b *Float32Builder) Append(v float32)

func (*Float32Builder) AppendEmptyValue

func (b *Float32Builder) AppendEmptyValue()

func (*Float32Builder) AppendEmptyValues

func (b *Float32Builder) AppendEmptyValues(n int)

func (*Float32Builder) AppendNull

func (b *Float32Builder) AppendNull()

func (*Float32Builder) AppendNulls

func (b *Float32Builder) AppendNulls(n int)

func (*Float32Builder) AppendValueFromString

func (b *Float32Builder) AppendValueFromString(s string) error

func (*Float32Builder) AppendValues

func (b *Float32Builder) AppendValues(v []float32, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Float32Builder) Cap

func (b *Float32Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Float32Builder) IsNull

func (b *Float32Builder) IsNull(i int) bool

func (*Float32Builder) Len

func (b *Float32Builder) Len() int

Len returns the number of elements in the array builder.

func (*Float32Builder) NewArray

func (b *Float32Builder) NewArray() arrow.Array

NewArray creates a Float32 array from the memory buffers used by the builder and resets the Float32Builder so it can be used to build a new array.

func (*Float32Builder) NewFloat32Array

func (b *Float32Builder) NewFloat32Array() (a *Float32)

NewFloat32Array creates a Float32 array from the memory buffers used by the builder and resets the Float32Builder so it can be used to build a new array.

func (*Float32Builder) NullN

func (b *Float32Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Float32Builder) Release

func (b *Float32Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Float32Builder) Reserve

func (b *Float32Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Float32Builder) Resize

func (b *Float32Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Float32Builder) Retain

func (b *Float32Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Float32Builder) SetNull

func (b *Float32Builder) SetNull(i int)

func (*Float32Builder) Type

func (b *Float32Builder) Type() arrow.DataType

func (*Float32Builder) Unmarshal

func (b *Float32Builder) Unmarshal(dec *json.Decoder) error

func (*Float32Builder) UnmarshalJSON

func (b *Float32Builder) UnmarshalJSON(data []byte) error

func (*Float32Builder) UnmarshalOne

func (b *Float32Builder) UnmarshalOne(dec *json.Decoder) error

func (*Float32Builder) UnsafeAppend

func (b *Float32Builder) UnsafeAppend(v float32)

func (*Float32Builder) UnsafeAppendBoolToBitmap

func (b *Float32Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Float32Builder) Value

func (b *Float32Builder) Value(i int) float32

type Float32DictionaryBuilder

type Float32DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Float32DictionaryBuilder) Append

func (b *Float32DictionaryBuilder) Append(v float32) error

func (*Float32DictionaryBuilder) AppendArray

func (b *Float32DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Float32DictionaryBuilder) AppendEmptyValue

func (b *Float32DictionaryBuilder) AppendEmptyValue()

func (*Float32DictionaryBuilder) AppendEmptyValues

func (b *Float32DictionaryBuilder) AppendEmptyValues(n int)

func (*Float32DictionaryBuilder) AppendIndices

func (b *Float32DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Float32DictionaryBuilder) AppendNull

func (b *Float32DictionaryBuilder) AppendNull()

func (*Float32DictionaryBuilder) AppendNulls

func (b *Float32DictionaryBuilder) AppendNulls(n int)

func (*Float32DictionaryBuilder) AppendValueFromString

func (b *Float32DictionaryBuilder) AppendValueFromString(s string) error

func (*Float32DictionaryBuilder) Cap

func (b *Float32DictionaryBuilder) Cap() int

func (*Float32DictionaryBuilder) DictionarySize

func (b *Float32DictionaryBuilder) DictionarySize() int

func (*Float32DictionaryBuilder) IndexBuilder

func (b *Float32DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Float32DictionaryBuilder) InsertDictValues

func (b *Float32DictionaryBuilder) InsertDictValues(arr *Float32) (err error)

func (*Float32DictionaryBuilder) IsNull

func (b *Float32DictionaryBuilder) IsNull(i int) bool

func (*Float32DictionaryBuilder) NewArray

func (b *Float32DictionaryBuilder) NewArray() arrow.Array

func (*Float32DictionaryBuilder) NewDelta

func (b *Float32DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Float32DictionaryBuilder) NewDictionaryArray

func (b *Float32DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Float32DictionaryBuilder) Release

func (b *Float32DictionaryBuilder) Release()

func (*Float32DictionaryBuilder) Reserve

func (b *Float32DictionaryBuilder) Reserve(n int)

func (*Float32DictionaryBuilder) ResetFull

func (b *Float32DictionaryBuilder) ResetFull()

func (*Float32DictionaryBuilder) Resize

func (b *Float32DictionaryBuilder) Resize(n int)

func (*Float32DictionaryBuilder) Type

func (b *Float32DictionaryBuilder) Type() arrow.DataType

func (*Float32DictionaryBuilder) Unmarshal

func (b *Float32DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Float32DictionaryBuilder) UnmarshalJSON

func (b *Float32DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Float32DictionaryBuilder) UnmarshalOne

func (b *Float32DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Float64

type Float64 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of float64 values.

func NewFloat64Data

func NewFloat64Data(data arrow.ArrayData) *Float64

NewFloat64Data creates a new Float64.

func (*Float64) Data

func (a *Float64) Data() arrow.ArrayData

func (*Float64) DataType

func (a *Float64) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Float64) Float64Values

func (a *Float64) Float64Values() []float64

Values returns the values.

func (*Float64) GetOneForMarshal

func (a *Float64) GetOneForMarshal(i int) interface{}

func (*Float64) IsNull

func (a *Float64) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Float64) IsValid

func (a *Float64) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Float64) Len

func (a *Float64) Len() int

Len returns the number of elements in the array.

func (*Float64) MarshalJSON

func (a *Float64) MarshalJSON() ([]byte, error)

func (*Float64) NullBitmapBytes

func (a *Float64) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Float64) NullN

func (a *Float64) NullN() int

NullN returns the number of null values in the array.

func (*Float64) Offset

func (a *Float64) Offset() int

func (*Float64) Release

func (a *Float64) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Float64) Reset

func (a *Float64) Reset(data *Data)

Reset resets the array for re-use.

func (*Float64) Retain

func (a *Float64) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Float64) String

func (a *Float64) String() string

String returns a string representation of the array.

func (*Float64) Value

func (a *Float64) Value(i int) float64

Value returns the value at the specified index.

func (*Float64) ValueStr

func (a *Float64) ValueStr(i int) string

type Float64Builder

type Float64Builder struct {
	// contains filtered or unexported fields
}

func NewFloat64Builder

func NewFloat64Builder(mem memory.Allocator) *Float64Builder

func (*Float64Builder) Append

func (b *Float64Builder) Append(v float64)

func (*Float64Builder) AppendEmptyValue

func (b *Float64Builder) AppendEmptyValue()

func (*Float64Builder) AppendEmptyValues

func (b *Float64Builder) AppendEmptyValues(n int)

func (*Float64Builder) AppendNull

func (b *Float64Builder) AppendNull()

func (*Float64Builder) AppendNulls

func (b *Float64Builder) AppendNulls(n int)

func (*Float64Builder) AppendValueFromString

func (b *Float64Builder) AppendValueFromString(s string) error

func (*Float64Builder) AppendValues

func (b *Float64Builder) AppendValues(v []float64, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Float64Builder) Cap

func (b *Float64Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Float64Builder) IsNull

func (b *Float64Builder) IsNull(i int) bool

func (*Float64Builder) Len

func (b *Float64Builder) Len() int

Len returns the number of elements in the array builder.

func (*Float64Builder) NewArray

func (b *Float64Builder) NewArray() arrow.Array

NewArray creates a Float64 array from the memory buffers used by the builder and resets the Float64Builder so it can be used to build a new array.

func (*Float64Builder) NewFloat64Array

func (b *Float64Builder) NewFloat64Array() (a *Float64)

NewFloat64Array creates a Float64 array from the memory buffers used by the builder and resets the Float64Builder so it can be used to build a new array.

func (*Float64Builder) NullN

func (b *Float64Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Float64Builder) Release

func (b *Float64Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Float64Builder) Reserve

func (b *Float64Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Float64Builder) Resize

func (b *Float64Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Float64Builder) Retain

func (b *Float64Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Float64Builder) SetNull

func (b *Float64Builder) SetNull(i int)

func (*Float64Builder) Type

func (b *Float64Builder) Type() arrow.DataType

func (*Float64Builder) Unmarshal

func (b *Float64Builder) Unmarshal(dec *json.Decoder) error

func (*Float64Builder) UnmarshalJSON

func (b *Float64Builder) UnmarshalJSON(data []byte) error

func (*Float64Builder) UnmarshalOne

func (b *Float64Builder) UnmarshalOne(dec *json.Decoder) error

func (*Float64Builder) UnsafeAppend

func (b *Float64Builder) UnsafeAppend(v float64)

func (*Float64Builder) UnsafeAppendBoolToBitmap

func (b *Float64Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Float64Builder) Value

func (b *Float64Builder) Value(i int) float64

type Float64DictionaryBuilder

type Float64DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Float64DictionaryBuilder) Append

func (b *Float64DictionaryBuilder) Append(v float64) error

func (*Float64DictionaryBuilder) AppendArray

func (b *Float64DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Float64DictionaryBuilder) AppendEmptyValue

func (b *Float64DictionaryBuilder) AppendEmptyValue()

func (*Float64DictionaryBuilder) AppendEmptyValues

func (b *Float64DictionaryBuilder) AppendEmptyValues(n int)

func (*Float64DictionaryBuilder) AppendIndices

func (b *Float64DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Float64DictionaryBuilder) AppendNull

func (b *Float64DictionaryBuilder) AppendNull()

func (*Float64DictionaryBuilder) AppendNulls

func (b *Float64DictionaryBuilder) AppendNulls(n int)

func (*Float64DictionaryBuilder) AppendValueFromString

func (b *Float64DictionaryBuilder) AppendValueFromString(s string) error

func (*Float64DictionaryBuilder) Cap

func (b *Float64DictionaryBuilder) Cap() int

func (*Float64DictionaryBuilder) DictionarySize

func (b *Float64DictionaryBuilder) DictionarySize() int

func (*Float64DictionaryBuilder) IndexBuilder

func (b *Float64DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Float64DictionaryBuilder) InsertDictValues

func (b *Float64DictionaryBuilder) InsertDictValues(arr *Float64) (err error)

func (*Float64DictionaryBuilder) IsNull

func (b *Float64DictionaryBuilder) IsNull(i int) bool

func (*Float64DictionaryBuilder) NewArray

func (b *Float64DictionaryBuilder) NewArray() arrow.Array

func (*Float64DictionaryBuilder) NewDelta

func (b *Float64DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Float64DictionaryBuilder) NewDictionaryArray

func (b *Float64DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Float64DictionaryBuilder) Release

func (b *Float64DictionaryBuilder) Release()

func (*Float64DictionaryBuilder) Reserve

func (b *Float64DictionaryBuilder) Reserve(n int)

func (*Float64DictionaryBuilder) ResetFull

func (b *Float64DictionaryBuilder) ResetFull()

func (*Float64DictionaryBuilder) Resize

func (b *Float64DictionaryBuilder) Resize(n int)

func (*Float64DictionaryBuilder) Type

func (b *Float64DictionaryBuilder) Type() arrow.DataType

func (*Float64DictionaryBuilder) Unmarshal

func (b *Float64DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Float64DictionaryBuilder) UnmarshalJSON

func (b *Float64DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Float64DictionaryBuilder) UnmarshalOne

func (b *Float64DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type FromJSONOption

type FromJSONOption func(*fromJSONCfg)

func WithMultipleDocs

func WithMultipleDocs() FromJSONOption

func WithStartOffset

func WithStartOffset(off int64) FromJSONOption

WithStartOffset attempts to start decoding from the reader at the offset passed in. If using this option the reader must fulfill the io.ReadSeeker interface, or else an error will be returned.

It will call Seek(off, io.SeekStart) on the reader

func WithUseNumber

func WithUseNumber() FromJSONOption

WithUseNumber enables the 'UseNumber' option on the json decoder, using the json.Number type instead of assuming float64 for numbers. This is critical if you have numbers that are larger than what can fit into the 53 bits of an IEEE float64 mantissa and want to preserve its value.

type IndexBuilder

type IndexBuilder struct {
	Builder
	Append func(int)
}

helper for building the properly typed indices of the dictionary builder

type Int16

type Int16 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of int16 values.

func NewInt16Data

func NewInt16Data(data arrow.ArrayData) *Int16

NewInt16Data creates a new Int16.

func (*Int16) Data

func (a *Int16) Data() arrow.ArrayData

func (*Int16) DataType

func (a *Int16) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Int16) GetOneForMarshal

func (a *Int16) GetOneForMarshal(i int) interface{}

func (*Int16) Int16Values

func (a *Int16) Int16Values() []int16

Values returns the values.

func (*Int16) IsNull

func (a *Int16) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Int16) IsValid

func (a *Int16) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Int16) Len

func (a *Int16) Len() int

Len returns the number of elements in the array.

func (*Int16) MarshalJSON

func (a *Int16) MarshalJSON() ([]byte, error)

func (*Int16) NullBitmapBytes

func (a *Int16) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Int16) NullN

func (a *Int16) NullN() int

NullN returns the number of null values in the array.

func (*Int16) Offset

func (a *Int16) Offset() int

func (*Int16) Release

func (a *Int16) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Int16) Reset

func (a *Int16) Reset(data *Data)

Reset resets the array for re-use.

func (*Int16) Retain

func (a *Int16) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Int16) String

func (a *Int16) String() string

String returns a string representation of the array.

func (*Int16) Value

func (a *Int16) Value(i int) int16

Value returns the value at the specified index.

func (*Int16) ValueStr

func (a *Int16) ValueStr(i int) string

type Int16Builder

type Int16Builder struct {
	// contains filtered or unexported fields
}

func NewInt16Builder

func NewInt16Builder(mem memory.Allocator) *Int16Builder

func (*Int16Builder) Append

func (b *Int16Builder) Append(v int16)

func (*Int16Builder) AppendEmptyValue

func (b *Int16Builder) AppendEmptyValue()

func (*Int16Builder) AppendEmptyValues

func (b *Int16Builder) AppendEmptyValues(n int)

func (*Int16Builder) AppendNull

func (b *Int16Builder) AppendNull()

func (*Int16Builder) AppendNulls

func (b *Int16Builder) AppendNulls(n int)

func (*Int16Builder) AppendValueFromString

func (b *Int16Builder) AppendValueFromString(s string) error

func (*Int16Builder) AppendValues

func (b *Int16Builder) AppendValues(v []int16, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Int16Builder) Cap

func (b *Int16Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Int16Builder) IsNull

func (b *Int16Builder) IsNull(i int) bool

func (*Int16Builder) Len

func (b *Int16Builder) Len() int

Len returns the number of elements in the array builder.

func (*Int16Builder) NewArray

func (b *Int16Builder) NewArray() arrow.Array

NewArray creates a Int16 array from the memory buffers used by the builder and resets the Int16Builder so it can be used to build a new array.

func (*Int16Builder) NewInt16Array

func (b *Int16Builder) NewInt16Array() (a *Int16)

NewInt16Array creates a Int16 array from the memory buffers used by the builder and resets the Int16Builder so it can be used to build a new array.

func (*Int16Builder) NullN

func (b *Int16Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Int16Builder) Release

func (b *Int16Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Int16Builder) Reserve

func (b *Int16Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Int16Builder) Resize

func (b *Int16Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Int16Builder) Retain

func (b *Int16Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Int16Builder) SetNull

func (b *Int16Builder) SetNull(i int)

func (*Int16Builder) Type

func (b *Int16Builder) Type() arrow.DataType

func (*Int16Builder) Unmarshal

func (b *Int16Builder) Unmarshal(dec *json.Decoder) error

func (*Int16Builder) UnmarshalJSON

func (b *Int16Builder) UnmarshalJSON(data []byte) error

func (*Int16Builder) UnmarshalOne

func (b *Int16Builder) UnmarshalOne(dec *json.Decoder) error

func (*Int16Builder) UnsafeAppend

func (b *Int16Builder) UnsafeAppend(v int16)

func (*Int16Builder) UnsafeAppendBoolToBitmap

func (b *Int16Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Int16Builder) Value

func (b *Int16Builder) Value(i int) int16

type Int16DictionaryBuilder

type Int16DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Int16DictionaryBuilder) Append

func (b *Int16DictionaryBuilder) Append(v int16) error

func (*Int16DictionaryBuilder) AppendArray

func (b *Int16DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Int16DictionaryBuilder) AppendEmptyValue

func (b *Int16DictionaryBuilder) AppendEmptyValue()

func (*Int16DictionaryBuilder) AppendEmptyValues

func (b *Int16DictionaryBuilder) AppendEmptyValues(n int)

func (*Int16DictionaryBuilder) AppendIndices

func (b *Int16DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Int16DictionaryBuilder) AppendNull

func (b *Int16DictionaryBuilder) AppendNull()

func (*Int16DictionaryBuilder) AppendNulls

func (b *Int16DictionaryBuilder) AppendNulls(n int)

func (*Int16DictionaryBuilder) AppendValueFromString

func (b *Int16DictionaryBuilder) AppendValueFromString(s string) error

func (*Int16DictionaryBuilder) Cap

func (b *Int16DictionaryBuilder) Cap() int

func (*Int16DictionaryBuilder) DictionarySize

func (b *Int16DictionaryBuilder) DictionarySize() int

func (*Int16DictionaryBuilder) IndexBuilder

func (b *Int16DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Int16DictionaryBuilder) InsertDictValues

func (b *Int16DictionaryBuilder) InsertDictValues(arr *Int16) (err error)

func (*Int16DictionaryBuilder) IsNull

func (b *Int16DictionaryBuilder) IsNull(i int) bool

func (*Int16DictionaryBuilder) NewArray

func (b *Int16DictionaryBuilder) NewArray() arrow.Array

func (*Int16DictionaryBuilder) NewDelta

func (b *Int16DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Int16DictionaryBuilder) NewDictionaryArray

func (b *Int16DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Int16DictionaryBuilder) Release

func (b *Int16DictionaryBuilder) Release()

func (*Int16DictionaryBuilder) Reserve

func (b *Int16DictionaryBuilder) Reserve(n int)

func (*Int16DictionaryBuilder) ResetFull

func (b *Int16DictionaryBuilder) ResetFull()

func (*Int16DictionaryBuilder) Resize

func (b *Int16DictionaryBuilder) Resize(n int)

func (*Int16DictionaryBuilder) Type

func (b *Int16DictionaryBuilder) Type() arrow.DataType

func (*Int16DictionaryBuilder) Unmarshal

func (b *Int16DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Int16DictionaryBuilder) UnmarshalJSON

func (b *Int16DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Int16DictionaryBuilder) UnmarshalOne

func (b *Int16DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Int32

type Int32 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of int32 values.

func NewInt32Data

func NewInt32Data(data arrow.ArrayData) *Int32

NewInt32Data creates a new Int32.

func (*Int32) Data

func (a *Int32) Data() arrow.ArrayData

func (*Int32) DataType

func (a *Int32) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Int32) GetOneForMarshal

func (a *Int32) GetOneForMarshal(i int) interface{}

func (*Int32) Int32Values

func (a *Int32) Int32Values() []int32

Values returns the values.

func (*Int32) IsNull

func (a *Int32) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Int32) IsValid

func (a *Int32) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Int32) Len

func (a *Int32) Len() int

Len returns the number of elements in the array.

func (*Int32) MarshalJSON

func (a *Int32) MarshalJSON() ([]byte, error)

func (*Int32) NullBitmapBytes

func (a *Int32) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Int32) NullN

func (a *Int32) NullN() int

NullN returns the number of null values in the array.

func (*Int32) Offset

func (a *Int32) Offset() int

func (*Int32) Release

func (a *Int32) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Int32) Reset

func (a *Int32) Reset(data *Data)

Reset resets the array for re-use.

func (*Int32) Retain

func (a *Int32) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Int32) String

func (a *Int32) String() string

String returns a string representation of the array.

func (*Int32) Value

func (a *Int32) Value(i int) int32

Value returns the value at the specified index.

func (*Int32) ValueStr

func (a *Int32) ValueStr(i int) string

type Int32Builder

type Int32Builder struct {
	// contains filtered or unexported fields
}

func NewInt32Builder

func NewInt32Builder(mem memory.Allocator) *Int32Builder

func (*Int32Builder) Append

func (b *Int32Builder) Append(v int32)

func (*Int32Builder) AppendEmptyValue

func (b *Int32Builder) AppendEmptyValue()

func (*Int32Builder) AppendEmptyValues

func (b *Int32Builder) AppendEmptyValues(n int)

func (*Int32Builder) AppendNull

func (b *Int32Builder) AppendNull()

func (*Int32Builder) AppendNulls

func (b *Int32Builder) AppendNulls(n int)

func (*Int32Builder) AppendValueFromString

func (b *Int32Builder) AppendValueFromString(s string) error

func (*Int32Builder) AppendValues

func (b *Int32Builder) AppendValues(v []int32, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Int32Builder) Cap

func (b *Int32Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Int32Builder) IsNull

func (b *Int32Builder) IsNull(i int) bool

func (*Int32Builder) Len

func (b *Int32Builder) Len() int

Len returns the number of elements in the array builder.

func (*Int32Builder) NewArray

func (b *Int32Builder) NewArray() arrow.Array

NewArray creates a Int32 array from the memory buffers used by the builder and resets the Int32Builder so it can be used to build a new array.

func (*Int32Builder) NewInt32Array

func (b *Int32Builder) NewInt32Array() (a *Int32)

NewInt32Array creates a Int32 array from the memory buffers used by the builder and resets the Int32Builder so it can be used to build a new array.

func (*Int32Builder) NullN

func (b *Int32Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Int32Builder) Release

func (b *Int32Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Int32Builder) Reserve

func (b *Int32Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Int32Builder) Resize

func (b *Int32Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Int32Builder) Retain

func (b *Int32Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Int32Builder) SetNull

func (b *Int32Builder) SetNull(i int)

func (*Int32Builder) Type

func (b *Int32Builder) Type() arrow.DataType

func (*Int32Builder) Unmarshal

func (b *Int32Builder) Unmarshal(dec *json.Decoder) error

func (*Int32Builder) UnmarshalJSON

func (b *Int32Builder) UnmarshalJSON(data []byte) error

func (*Int32Builder) UnmarshalOne

func (b *Int32Builder) UnmarshalOne(dec *json.Decoder) error

func (*Int32Builder) UnsafeAppend

func (b *Int32Builder) UnsafeAppend(v int32)

func (*Int32Builder) UnsafeAppendBoolToBitmap

func (b *Int32Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Int32Builder) Value

func (b *Int32Builder) Value(i int) int32

type Int32DictionaryBuilder

type Int32DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Int32DictionaryBuilder) Append

func (b *Int32DictionaryBuilder) Append(v int32) error

func (*Int32DictionaryBuilder) AppendArray

func (b *Int32DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Int32DictionaryBuilder) AppendEmptyValue

func (b *Int32DictionaryBuilder) AppendEmptyValue()

func (*Int32DictionaryBuilder) AppendEmptyValues

func (b *Int32DictionaryBuilder) AppendEmptyValues(n int)

func (*Int32DictionaryBuilder) AppendIndices

func (b *Int32DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Int32DictionaryBuilder) AppendNull

func (b *Int32DictionaryBuilder) AppendNull()

func (*Int32DictionaryBuilder) AppendNulls

func (b *Int32DictionaryBuilder) AppendNulls(n int)

func (*Int32DictionaryBuilder) AppendValueFromString

func (b *Int32DictionaryBuilder) AppendValueFromString(s string) error

func (*Int32DictionaryBuilder) Cap

func (b *Int32DictionaryBuilder) Cap() int

func (*Int32DictionaryBuilder) DictionarySize

func (b *Int32DictionaryBuilder) DictionarySize() int

func (*Int32DictionaryBuilder) IndexBuilder

func (b *Int32DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Int32DictionaryBuilder) InsertDictValues

func (b *Int32DictionaryBuilder) InsertDictValues(arr *Int32) (err error)

func (*Int32DictionaryBuilder) IsNull

func (b *Int32DictionaryBuilder) IsNull(i int) bool

func (*Int32DictionaryBuilder) NewArray

func (b *Int32DictionaryBuilder) NewArray() arrow.Array

func (*Int32DictionaryBuilder) NewDelta

func (b *Int32DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Int32DictionaryBuilder) NewDictionaryArray

func (b *Int32DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Int32DictionaryBuilder) Release

func (b *Int32DictionaryBuilder) Release()

func (*Int32DictionaryBuilder) Reserve

func (b *Int32DictionaryBuilder) Reserve(n int)

func (*Int32DictionaryBuilder) ResetFull

func (b *Int32DictionaryBuilder) ResetFull()

func (*Int32DictionaryBuilder) Resize

func (b *Int32DictionaryBuilder) Resize(n int)

func (*Int32DictionaryBuilder) Type

func (b *Int32DictionaryBuilder) Type() arrow.DataType

func (*Int32DictionaryBuilder) Unmarshal

func (b *Int32DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Int32DictionaryBuilder) UnmarshalJSON

func (b *Int32DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Int32DictionaryBuilder) UnmarshalOne

func (b *Int32DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Int64

type Int64 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of int64 values.

func NewInt64Data

func NewInt64Data(data arrow.ArrayData) *Int64

NewInt64Data creates a new Int64.

func (*Int64) Data

func (a *Int64) Data() arrow.ArrayData

func (*Int64) DataType

func (a *Int64) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Int64) GetOneForMarshal

func (a *Int64) GetOneForMarshal(i int) interface{}

func (*Int64) Int64Values

func (a *Int64) Int64Values() []int64

Values returns the values.

func (*Int64) IsNull

func (a *Int64) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Int64) IsValid

func (a *Int64) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Int64) Len

func (a *Int64) Len() int

Len returns the number of elements in the array.

func (*Int64) MarshalJSON

func (a *Int64) MarshalJSON() ([]byte, error)

func (*Int64) NullBitmapBytes

func (a *Int64) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Int64) NullN

func (a *Int64) NullN() int

NullN returns the number of null values in the array.

func (*Int64) Offset

func (a *Int64) Offset() int

func (*Int64) Release

func (a *Int64) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Int64) Reset

func (a *Int64) Reset(data *Data)

Reset resets the array for re-use.

func (*Int64) Retain

func (a *Int64) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Int64) String

func (a *Int64) String() string

String returns a string representation of the array.

func (*Int64) Value

func (a *Int64) Value(i int) int64

Value returns the value at the specified index.

func (*Int64) ValueStr

func (a *Int64) ValueStr(i int) string

type Int64Builder

type Int64Builder struct {
	// contains filtered or unexported fields
}

func NewInt64Builder

func NewInt64Builder(mem memory.Allocator) *Int64Builder

func (*Int64Builder) Append

func (b *Int64Builder) Append(v int64)

func (*Int64Builder) AppendEmptyValue

func (b *Int64Builder) AppendEmptyValue()

func (*Int64Builder) AppendEmptyValues

func (b *Int64Builder) AppendEmptyValues(n int)

func (*Int64Builder) AppendNull

func (b *Int64Builder) AppendNull()

func (*Int64Builder) AppendNulls

func (b *Int64Builder) AppendNulls(n int)

func (*Int64Builder) AppendValueFromString

func (b *Int64Builder) AppendValueFromString(s string) error

func (*Int64Builder) AppendValues

func (b *Int64Builder) AppendValues(v []int64, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Int64Builder) Cap

func (b *Int64Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Int64Builder) IsNull

func (b *Int64Builder) IsNull(i int) bool

func (*Int64Builder) Len

func (b *Int64Builder) Len() int

Len returns the number of elements in the array builder.

func (*Int64Builder) NewArray

func (b *Int64Builder) NewArray() arrow.Array

NewArray creates a Int64 array from the memory buffers used by the builder and resets the Int64Builder so it can be used to build a new array.

func (*Int64Builder) NewInt64Array

func (b *Int64Builder) NewInt64Array() (a *Int64)

NewInt64Array creates a Int64 array from the memory buffers used by the builder and resets the Int64Builder so it can be used to build a new array.

func (*Int64Builder) NullN

func (b *Int64Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Int64Builder) Release

func (b *Int64Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Int64Builder) Reserve

func (b *Int64Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Int64Builder) Resize

func (b *Int64Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Int64Builder) Retain

func (b *Int64Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Int64Builder) SetNull

func (b *Int64Builder) SetNull(i int)

func (*Int64Builder) Type

func (b *Int64Builder) Type() arrow.DataType

func (*Int64Builder) Unmarshal

func (b *Int64Builder) Unmarshal(dec *json.Decoder) error

func (*Int64Builder) UnmarshalJSON

func (b *Int64Builder) UnmarshalJSON(data []byte) error

func (*Int64Builder) UnmarshalOne

func (b *Int64Builder) UnmarshalOne(dec *json.Decoder) error

func (*Int64Builder) UnsafeAppend

func (b *Int64Builder) UnsafeAppend(v int64)

func (*Int64Builder) UnsafeAppendBoolToBitmap

func (b *Int64Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Int64Builder) Value

func (b *Int64Builder) Value(i int) int64

type Int64DictionaryBuilder

type Int64DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Int64DictionaryBuilder) Append

func (b *Int64DictionaryBuilder) Append(v int64) error

func (*Int64DictionaryBuilder) AppendArray

func (b *Int64DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Int64DictionaryBuilder) AppendEmptyValue

func (b *Int64DictionaryBuilder) AppendEmptyValue()

func (*Int64DictionaryBuilder) AppendEmptyValues

func (b *Int64DictionaryBuilder) AppendEmptyValues(n int)

func (*Int64DictionaryBuilder) AppendIndices

func (b *Int64DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Int64DictionaryBuilder) AppendNull

func (b *Int64DictionaryBuilder) AppendNull()

func (*Int64DictionaryBuilder) AppendNulls

func (b *Int64DictionaryBuilder) AppendNulls(n int)

func (*Int64DictionaryBuilder) AppendValueFromString

func (b *Int64DictionaryBuilder) AppendValueFromString(s string) error

func (*Int64DictionaryBuilder) Cap

func (b *Int64DictionaryBuilder) Cap() int

func (*Int64DictionaryBuilder) DictionarySize

func (b *Int64DictionaryBuilder) DictionarySize() int

func (*Int64DictionaryBuilder) IndexBuilder

func (b *Int64DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Int64DictionaryBuilder) InsertDictValues

func (b *Int64DictionaryBuilder) InsertDictValues(arr *Int64) (err error)

func (*Int64DictionaryBuilder) IsNull

func (b *Int64DictionaryBuilder) IsNull(i int) bool

func (*Int64DictionaryBuilder) NewArray

func (b *Int64DictionaryBuilder) NewArray() arrow.Array

func (*Int64DictionaryBuilder) NewDelta

func (b *Int64DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Int64DictionaryBuilder) NewDictionaryArray

func (b *Int64DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Int64DictionaryBuilder) Release

func (b *Int64DictionaryBuilder) Release()

func (*Int64DictionaryBuilder) Reserve

func (b *Int64DictionaryBuilder) Reserve(n int)

func (*Int64DictionaryBuilder) ResetFull

func (b *Int64DictionaryBuilder) ResetFull()

func (*Int64DictionaryBuilder) Resize

func (b *Int64DictionaryBuilder) Resize(n int)

func (*Int64DictionaryBuilder) Type

func (b *Int64DictionaryBuilder) Type() arrow.DataType

func (*Int64DictionaryBuilder) Unmarshal

func (b *Int64DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Int64DictionaryBuilder) UnmarshalJSON

func (b *Int64DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Int64DictionaryBuilder) UnmarshalOne

func (b *Int64DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Int8

type Int8 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of int8 values.

func NewInt8Data

func NewInt8Data(data arrow.ArrayData) *Int8

NewInt8Data creates a new Int8.

func (*Int8) Data

func (a *Int8) Data() arrow.ArrayData

func (*Int8) DataType

func (a *Int8) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Int8) GetOneForMarshal

func (a *Int8) GetOneForMarshal(i int) interface{}

func (*Int8) Int8Values

func (a *Int8) Int8Values() []int8

Values returns the values.

func (*Int8) IsNull

func (a *Int8) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Int8) IsValid

func (a *Int8) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Int8) Len

func (a *Int8) Len() int

Len returns the number of elements in the array.

func (*Int8) MarshalJSON

func (a *Int8) MarshalJSON() ([]byte, error)

func (*Int8) NullBitmapBytes

func (a *Int8) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Int8) NullN

func (a *Int8) NullN() int

NullN returns the number of null values in the array.

func (*Int8) Offset

func (a *Int8) Offset() int

func (*Int8) Release

func (a *Int8) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Int8) Reset

func (a *Int8) Reset(data *Data)

Reset resets the array for re-use.

func (*Int8) Retain

func (a *Int8) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Int8) String

func (a *Int8) String() string

String returns a string representation of the array.

func (*Int8) Value

func (a *Int8) Value(i int) int8

Value returns the value at the specified index.

func (*Int8) ValueStr

func (a *Int8) ValueStr(i int) string

type Int8Builder

type Int8Builder struct {
	// contains filtered or unexported fields
}

func NewInt8Builder

func NewInt8Builder(mem memory.Allocator) *Int8Builder

func (*Int8Builder) Append

func (b *Int8Builder) Append(v int8)

func (*Int8Builder) AppendEmptyValue

func (b *Int8Builder) AppendEmptyValue()

func (*Int8Builder) AppendEmptyValues

func (b *Int8Builder) AppendEmptyValues(n int)

func (*Int8Builder) AppendNull

func (b *Int8Builder) AppendNull()

func (*Int8Builder) AppendNulls

func (b *Int8Builder) AppendNulls(n int)

func (*Int8Builder) AppendValueFromString

func (b *Int8Builder) AppendValueFromString(s string) error

func (*Int8Builder) AppendValues

func (b *Int8Builder) AppendValues(v []int8, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Int8Builder) Cap

func (b *Int8Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Int8Builder) IsNull

func (b *Int8Builder) IsNull(i int) bool

func (*Int8Builder) Len

func (b *Int8Builder) Len() int

Len returns the number of elements in the array builder.

func (*Int8Builder) NewArray

func (b *Int8Builder) NewArray() arrow.Array

NewArray creates a Int8 array from the memory buffers used by the builder and resets the Int8Builder so it can be used to build a new array.

func (*Int8Builder) NewInt8Array

func (b *Int8Builder) NewInt8Array() (a *Int8)

NewInt8Array creates a Int8 array from the memory buffers used by the builder and resets the Int8Builder so it can be used to build a new array.

func (*Int8Builder) NullN

func (b *Int8Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Int8Builder) Release

func (b *Int8Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Int8Builder) Reserve

func (b *Int8Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Int8Builder) Resize

func (b *Int8Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Int8Builder) Retain

func (b *Int8Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Int8Builder) SetNull

func (b *Int8Builder) SetNull(i int)

func (*Int8Builder) Type

func (b *Int8Builder) Type() arrow.DataType

func (*Int8Builder) Unmarshal

func (b *Int8Builder) Unmarshal(dec *json.Decoder) error

func (*Int8Builder) UnmarshalJSON

func (b *Int8Builder) UnmarshalJSON(data []byte) error

func (*Int8Builder) UnmarshalOne

func (b *Int8Builder) UnmarshalOne(dec *json.Decoder) error

func (*Int8Builder) UnsafeAppend

func (b *Int8Builder) UnsafeAppend(v int8)

func (*Int8Builder) UnsafeAppendBoolToBitmap

func (b *Int8Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Int8Builder) Value

func (b *Int8Builder) Value(i int) int8

type Int8DictionaryBuilder

type Int8DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Int8DictionaryBuilder) Append

func (b *Int8DictionaryBuilder) Append(v int8) error

func (*Int8DictionaryBuilder) AppendArray

func (b *Int8DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Int8DictionaryBuilder) AppendEmptyValue

func (b *Int8DictionaryBuilder) AppendEmptyValue()

func (*Int8DictionaryBuilder) AppendEmptyValues

func (b *Int8DictionaryBuilder) AppendEmptyValues(n int)

func (*Int8DictionaryBuilder) AppendIndices

func (b *Int8DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Int8DictionaryBuilder) AppendNull

func (b *Int8DictionaryBuilder) AppendNull()

func (*Int8DictionaryBuilder) AppendNulls

func (b *Int8DictionaryBuilder) AppendNulls(n int)

func (*Int8DictionaryBuilder) AppendValueFromString

func (b *Int8DictionaryBuilder) AppendValueFromString(s string) error

func (*Int8DictionaryBuilder) Cap

func (b *Int8DictionaryBuilder) Cap() int

func (*Int8DictionaryBuilder) DictionarySize

func (b *Int8DictionaryBuilder) DictionarySize() int

func (*Int8DictionaryBuilder) IndexBuilder

func (b *Int8DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Int8DictionaryBuilder) InsertDictValues

func (b *Int8DictionaryBuilder) InsertDictValues(arr *Int8) (err error)

func (*Int8DictionaryBuilder) IsNull

func (b *Int8DictionaryBuilder) IsNull(i int) bool

func (*Int8DictionaryBuilder) NewArray

func (b *Int8DictionaryBuilder) NewArray() arrow.Array

func (*Int8DictionaryBuilder) NewDelta

func (b *Int8DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Int8DictionaryBuilder) NewDictionaryArray

func (b *Int8DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Int8DictionaryBuilder) Release

func (b *Int8DictionaryBuilder) Release()

func (*Int8DictionaryBuilder) Reserve

func (b *Int8DictionaryBuilder) Reserve(n int)

func (*Int8DictionaryBuilder) ResetFull

func (b *Int8DictionaryBuilder) ResetFull()

func (*Int8DictionaryBuilder) Resize

func (b *Int8DictionaryBuilder) Resize(n int)

func (*Int8DictionaryBuilder) Type

func (b *Int8DictionaryBuilder) Type() arrow.DataType

func (*Int8DictionaryBuilder) Unmarshal

func (b *Int8DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Int8DictionaryBuilder) UnmarshalJSON

func (b *Int8DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Int8DictionaryBuilder) UnmarshalOne

func (b *Int8DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type JSONReader

type JSONReader struct {
	// contains filtered or unexported fields
}

JSONReader is a json reader that meets the RecordReader interface definition.

To read in an array of objects as a record, you can use RecordFromJSON which is equivalent to reading the json as a struct array whose fields are the columns of the record. This primarily exists to fit the RecordReader interface as a matching reader for the csv reader.

func NewJSONReader

func NewJSONReader(r io.Reader, schema *arrow.Schema, opts ...Option) *JSONReader

NewJSONReader returns a json RecordReader which expects to find one json object per row of dataset. Using WithChunk can control how many rows are processed per record, which is how many objects become a single record from the file.

If it is desired to write out an array of rows, then simply use RecordToStructArray and json.Marshal the struct array for the same effect.

func (*JSONReader) Err

func (r *JSONReader) Err() error

Err returns the last encountered error

func (*JSONReader) Next

func (r *JSONReader) Next() bool

Next returns true if it read in a record, which will be available via Record and false if there is either an error or the end of the reader.

func (*JSONReader) Record

func (r *JSONReader) Record() arrow.Record

Record returns the last read in record. The returned record is only valid until the next call to Next unless Retain is called on the record itself.

func (*JSONReader) Release

func (r *JSONReader) Release()

func (*JSONReader) Retain

func (r *JSONReader) Retain()

func (*JSONReader) Schema

func (r *JSONReader) Schema() *arrow.Schema

type LargeBinary

type LargeBinary struct {
	// contains filtered or unexported fields
}

func NewLargeBinaryData

func NewLargeBinaryData(data arrow.ArrayData) *LargeBinary

func (*LargeBinary) Data

func (a *LargeBinary) Data() arrow.ArrayData

func (*LargeBinary) DataType

func (a *LargeBinary) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*LargeBinary) GetOneForMarshal

func (a *LargeBinary) GetOneForMarshal(i int) interface{}

func (*LargeBinary) IsNull

func (a *LargeBinary) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*LargeBinary) IsValid

func (a *LargeBinary) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*LargeBinary) Len

func (a *LargeBinary) Len() int

Len returns the number of elements in the array.

func (*LargeBinary) MarshalJSON

func (a *LargeBinary) MarshalJSON() ([]byte, error)

func (*LargeBinary) NullBitmapBytes

func (a *LargeBinary) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*LargeBinary) NullN

func (a *LargeBinary) NullN() int

NullN returns the number of null values in the array.

func (*LargeBinary) Offset

func (a *LargeBinary) Offset() int

func (*LargeBinary) Release

func (a *LargeBinary) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*LargeBinary) Retain

func (a *LargeBinary) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*LargeBinary) String

func (a *LargeBinary) String() string

func (*LargeBinary) Value

func (a *LargeBinary) Value(i int) []byte

func (*LargeBinary) ValueBytes

func (a *LargeBinary) ValueBytes() []byte

func (*LargeBinary) ValueLen

func (a *LargeBinary) ValueLen(i int) int

func (*LargeBinary) ValueOffset

func (a *LargeBinary) ValueOffset(i int) int64

func (*LargeBinary) ValueOffset64

func (a *LargeBinary) ValueOffset64(i int) int64

func (*LargeBinary) ValueOffsets

func (a *LargeBinary) ValueOffsets() []int64

func (*LargeBinary) ValueStr

func (a *LargeBinary) ValueStr(i int) string

func (*LargeBinary) ValueString

func (a *LargeBinary) ValueString(i int) string

type LargeList

type LargeList struct {
	// contains filtered or unexported fields
}

LargeList represents an immutable sequence of array values.

func NewLargeListData

func NewLargeListData(data arrow.ArrayData) *LargeList

NewLargeListData returns a new LargeList array value, from data.

func (*LargeList) Data

func (a *LargeList) Data() arrow.ArrayData

func (*LargeList) DataType

func (a *LargeList) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*LargeList) GetOneForMarshal

func (a *LargeList) GetOneForMarshal(i int) interface{}

func (*LargeList) IsNull

func (a *LargeList) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*LargeList) IsValid

func (a *LargeList) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*LargeList) Len

func (a *LargeList) Len() int

Len returns the number of elements in the array.

func (*LargeList) ListValues

func (a *LargeList) ListValues() arrow.Array

func (*LargeList) MarshalJSON

func (a *LargeList) MarshalJSON() ([]byte, error)

func (*LargeList) NullBitmapBytes

func (a *LargeList) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*LargeList) NullN

func (a *LargeList) NullN() int

NullN returns the number of null values in the array.

func (*LargeList) Offset

func (a *LargeList) Offset() int

func (*LargeList) Offsets

func (a *LargeList) Offsets() []int64

func (*LargeList) Release

func (a *LargeList) Release()

func (*LargeList) Retain

func (a *LargeList) Retain()

func (*LargeList) String

func (a *LargeList) String() string

func (*LargeList) ValueOffsets

func (a *LargeList) ValueOffsets(i int) (start, end int64)

func (*LargeList) ValueStr

func (a *LargeList) ValueStr(i int) string

type LargeListBuilder

type LargeListBuilder struct {
	// contains filtered or unexported fields
}

func NewLargeListBuilder

func NewLargeListBuilder(mem memory.Allocator, etype arrow.DataType) *LargeListBuilder

NewLargeListBuilder returns a builder, using the provided memory allocator. The created list builder will create a list whose elements will be of type etype.

func NewLargeListBuilderWithField

func NewLargeListBuilderWithField(mem memory.Allocator, field arrow.Field) *LargeListBuilder

NewLargeListBuilderWithField takes a field rather than just an element type to allow for more customization of the final type of the LargeList Array

func (*LargeListBuilder) Append

func (b *LargeListBuilder) Append(v bool)

func (*LargeListBuilder) AppendEmptyValue

func (b *LargeListBuilder) AppendEmptyValue()

func (*LargeListBuilder) AppendEmptyValues

func (b *LargeListBuilder) AppendEmptyValues(n int)

func (*LargeListBuilder) AppendNull

func (b *LargeListBuilder) AppendNull()

func (*LargeListBuilder) AppendNulls

func (b *LargeListBuilder) AppendNulls(n int)

func (*LargeListBuilder) AppendValueFromString

func (b *LargeListBuilder) AppendValueFromString(s string) error

func (*LargeListBuilder) AppendValues

func (b *LargeListBuilder) AppendValues(offsets []int64, valid []bool)

func (*LargeListBuilder) AppendWithSize

func (b *LargeListBuilder) AppendWithSize(v bool, _ int)

func (*LargeListBuilder) NewArray

func (b *LargeListBuilder) NewArray() arrow.Array

NewArray creates a LargeList array from the memory buffers used by the builder and resets the LargeListBuilder so it can be used to build a new array.

func (*LargeListBuilder) NewLargeListArray

func (b *LargeListBuilder) NewLargeListArray() (a *LargeList)

NewLargeListArray creates a List array from the memory buffers used by the builder and resets the LargeListBuilder so it can be used to build a new array.

func (*LargeListBuilder) Release

func (b *LargeListBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*LargeListBuilder) Reserve

func (b *LargeListBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*LargeListBuilder) Resize

func (b *LargeListBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*LargeListBuilder) Type

func (b *LargeListBuilder) Type() arrow.DataType

func (*LargeListBuilder) Unmarshal

func (b *LargeListBuilder) Unmarshal(dec *json.Decoder) error

func (*LargeListBuilder) UnmarshalJSON

func (b *LargeListBuilder) UnmarshalJSON(data []byte) error

func (*LargeListBuilder) UnmarshalOne

func (b *LargeListBuilder) UnmarshalOne(dec *json.Decoder) error

func (*LargeListBuilder) ValueBuilder

func (b *LargeListBuilder) ValueBuilder() Builder

type LargeListView

type LargeListView struct {
	// contains filtered or unexported fields
}

LargeListView represents an immutable sequence of array values defined by an offset into a child array and a length.

func NewLargeListViewData

func NewLargeListViewData(data arrow.ArrayData) *LargeListView

NewLargeListViewData returns a new LargeListView array value, from data.

func (*LargeListView) Data

func (a *LargeListView) Data() arrow.ArrayData

func (*LargeListView) DataType

func (a *LargeListView) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*LargeListView) GetOneForMarshal

func (a *LargeListView) GetOneForMarshal(i int) interface{}

func (*LargeListView) IsNull

func (a *LargeListView) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*LargeListView) IsValid

func (a *LargeListView) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*LargeListView) Len

func (a *LargeListView) Len() int

Len returns the number of elements in the array.

func (*LargeListView) ListValues

func (a *LargeListView) ListValues() arrow.Array

func (*LargeListView) MarshalJSON

func (a *LargeListView) MarshalJSON() ([]byte, error)

func (*LargeListView) NullBitmapBytes

func (a *LargeListView) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*LargeListView) NullN

func (a *LargeListView) NullN() int

NullN returns the number of null values in the array.

func (*LargeListView) Offset

func (a *LargeListView) Offset() int

func (*LargeListView) Offsets

func (a *LargeListView) Offsets() []int64

func (*LargeListView) Release

func (a *LargeListView) Release()

func (*LargeListView) Retain

func (a *LargeListView) Retain()

func (*LargeListView) Sizes

func (a *LargeListView) Sizes() []int64

func (*LargeListView) String

func (a *LargeListView) String() string

func (*LargeListView) Validate

func (a *LargeListView) Validate() error

func (*LargeListView) ValidateFull

func (a *LargeListView) ValidateFull() error

func (*LargeListView) ValueOffsets

func (a *LargeListView) ValueOffsets(i int) (start, end int64)

func (*LargeListView) ValueStr

func (a *LargeListView) ValueStr(i int) string

type LargeListViewBuilder

type LargeListViewBuilder struct {
	// contains filtered or unexported fields
}

func NewLargeListViewBuilder

func NewLargeListViewBuilder(mem memory.Allocator, etype arrow.DataType) *LargeListViewBuilder

NewLargeListViewBuilder returns a builder, using the provided memory allocator. The created list-view builder will create a list whose elements will be of type etype.

func NewLargeListViewBuilderWithField

func NewLargeListViewBuilderWithField(mem memory.Allocator, field arrow.Field) *LargeListViewBuilder

NewLargeListViewBuilderWithField takes a field rather than just an element type to allow for more customization of the final type of the LargeListView Array

func (*LargeListViewBuilder) Append

func (b *LargeListViewBuilder) Append(v bool)

func (*LargeListViewBuilder) AppendDimensions

func (b *LargeListViewBuilder) AppendDimensions(offset int, listSize int)

func (*LargeListViewBuilder) AppendEmptyValue

func (b *LargeListViewBuilder) AppendEmptyValue()

func (*LargeListViewBuilder) AppendEmptyValues

func (b *LargeListViewBuilder) AppendEmptyValues(n int)

func (*LargeListViewBuilder) AppendNull

func (b *LargeListViewBuilder) AppendNull()

func (*LargeListViewBuilder) AppendNulls

func (b *LargeListViewBuilder) AppendNulls(n int)

func (*LargeListViewBuilder) AppendValueFromString

func (b *LargeListViewBuilder) AppendValueFromString(s string) error

func (*LargeListViewBuilder) AppendValuesWithSizes

func (b *LargeListViewBuilder) AppendValuesWithSizes(offsets []int64, sizes []int64, valid []bool)

func (*LargeListViewBuilder) AppendWithSize

func (b *LargeListViewBuilder) AppendWithSize(v bool, listSize int)

func (*LargeListViewBuilder) NewArray

func (b *LargeListViewBuilder) NewArray() arrow.Array

NewArray creates a LargeListView array from the memory buffers used by the builder and resets the LargeListViewBuilder so it can be used to build a new array.

func (*LargeListViewBuilder) NewLargeListViewArray

func (b *LargeListViewBuilder) NewLargeListViewArray() (a *LargeListView)

NewLargeListViewArray creates a ListView array from the memory buffers used by the builder and resets the LargeListViewBuilder so it can be used to build a new array.

func (*LargeListViewBuilder) Release

func (b *LargeListViewBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*LargeListViewBuilder) Reserve

func (b *LargeListViewBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*LargeListViewBuilder) Resize

func (b *LargeListViewBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*LargeListViewBuilder) Type

func (b *LargeListViewBuilder) Type() arrow.DataType

func (*LargeListViewBuilder) Unmarshal

func (b *LargeListViewBuilder) Unmarshal(dec *json.Decoder) error

func (*LargeListViewBuilder) UnmarshalJSON

func (b *LargeListViewBuilder) UnmarshalJSON(data []byte) error

func (*LargeListViewBuilder) UnmarshalOne

func (b *LargeListViewBuilder) UnmarshalOne(dec *json.Decoder) error

func (*LargeListViewBuilder) ValueBuilder

func (b *LargeListViewBuilder) ValueBuilder() Builder

type LargeString

type LargeString struct {
	// contains filtered or unexported fields
}

String represents an immutable sequence of variable-length UTF-8 strings.

func NewLargeStringData

func NewLargeStringData(data arrow.ArrayData) *LargeString

NewStringData constructs a new String array from data.

func (*LargeString) Data

func (a *LargeString) Data() arrow.ArrayData

func (*LargeString) DataType

func (a *LargeString) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*LargeString) GetOneForMarshal

func (a *LargeString) GetOneForMarshal(i int) interface{}

func (*LargeString) IsNull

func (a *LargeString) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*LargeString) IsValid

func (a *LargeString) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*LargeString) Len

func (a *LargeString) Len() int

Len returns the number of elements in the array.

func (*LargeString) MarshalJSON

func (a *LargeString) MarshalJSON() ([]byte, error)

func (*LargeString) NullBitmapBytes

func (a *LargeString) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*LargeString) NullN

func (a *LargeString) NullN() int

NullN returns the number of null values in the array.

func (*LargeString) Offset

func (a *LargeString) Offset() int

func (*LargeString) Release

func (a *LargeString) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*LargeString) Reset

func (a *LargeString) Reset(data arrow.ArrayData)

Reset resets the String with a different set of Data.

func (*LargeString) Retain

func (a *LargeString) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*LargeString) String

func (a *LargeString) String() string

func (*LargeString) Value

func (a *LargeString) Value(i int) string

Value returns the slice at index i. This value should not be mutated.

func (*LargeString) ValueBytes

func (a *LargeString) ValueBytes() []byte

func (*LargeString) ValueLen

func (a *LargeString) ValueLen(i int) int

func (*LargeString) ValueOffset

func (a *LargeString) ValueOffset(i int) int64

ValueOffset returns the offset of the value at index i.

func (*LargeString) ValueOffset64

func (a *LargeString) ValueOffset64(i int) int64

func (*LargeString) ValueOffsets

func (a *LargeString) ValueOffsets() []int64

func (*LargeString) ValueStr

func (a *LargeString) ValueStr(i int) string

type LargeStringBuilder

type LargeStringBuilder struct {
	*BinaryBuilder
}

A LargeStringBuilder is used to build a LargeString array using the Append methods. LargeString is for when you need the offset buffer to be 64-bit integers instead of 32-bit integers.

func NewLargeStringBuilder

func NewLargeStringBuilder(mem memory.Allocator) *LargeStringBuilder

NewStringBuilder creates a new StringBuilder.

func (*LargeStringBuilder) Append

func (b *LargeStringBuilder) Append(v string)

Append appends a string to the builder.

func (*LargeStringBuilder) AppendValues

func (b *LargeStringBuilder) AppendValues(v []string, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (LargeStringBuilder) Cap

func (b LargeStringBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (LargeStringBuilder) IsNull

func (b LargeStringBuilder) IsNull(i int) bool

func (LargeStringBuilder) Len

func (b LargeStringBuilder) Len() int

Len returns the number of elements in the array builder.

func (*LargeStringBuilder) NewArray

func (b *LargeStringBuilder) NewArray() arrow.Array

NewArray creates a String array from the memory buffers used by the builder and resets the StringBuilder so it can be used to build a new array.

func (*LargeStringBuilder) NewLargeStringArray

func (b *LargeStringBuilder) NewLargeStringArray() (a *LargeString)

NewStringArray creates a String array from the memory buffers used by the builder and resets the StringBuilder so it can be used to build a new array.

func (LargeStringBuilder) NullN

func (b LargeStringBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (LargeStringBuilder) Retain

func (b LargeStringBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (LargeStringBuilder) SetNull

func (b LargeStringBuilder) SetNull(i int)

func (*LargeStringBuilder) Type

func (b *LargeStringBuilder) Type() arrow.DataType

func (*LargeStringBuilder) Unmarshal

func (b *LargeStringBuilder) Unmarshal(dec *json.Decoder) error

func (*LargeStringBuilder) UnmarshalJSON

func (b *LargeStringBuilder) UnmarshalJSON(data []byte) error

func (*LargeStringBuilder) UnmarshalOne

func (b *LargeStringBuilder) UnmarshalOne(dec *json.Decoder) error

func (LargeStringBuilder) UnsafeAppendBoolToBitmap

func (b LargeStringBuilder) UnsafeAppendBoolToBitmap(isValid bool)

func (*LargeStringBuilder) Value

func (b *LargeStringBuilder) Value(i int) string

Value returns the string at index i.

type List

type List struct {
	// contains filtered or unexported fields
}

List represents an immutable sequence of array values.

func NewListData

func NewListData(data arrow.ArrayData) *List

NewListData returns a new List array value, from data.

func (*List) Data

func (a *List) Data() arrow.ArrayData

func (*List) DataType

func (a *List) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*List) GetOneForMarshal

func (a *List) GetOneForMarshal(i int) interface{}

func (*List) IsNull

func (a *List) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*List) IsValid

func (a *List) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*List) Len

func (a *List) Len() int

Len returns the number of elements in the array.

func (*List) ListValues

func (a *List) ListValues() arrow.Array

func (*List) MarshalJSON

func (a *List) MarshalJSON() ([]byte, error)

func (*List) NullBitmapBytes

func (a *List) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*List) NullN

func (a *List) NullN() int

NullN returns the number of null values in the array.

func (*List) Offset

func (a *List) Offset() int

func (*List) Offsets

func (a *List) Offsets() []int32

func (*List) Release

func (a *List) Release()

func (*List) Retain

func (a *List) Retain()

func (*List) String

func (a *List) String() string

func (*List) ValueOffsets

func (a *List) ValueOffsets(i int) (start, end int64)

func (*List) ValueStr

func (a *List) ValueStr(i int) string

type ListBuilder

type ListBuilder struct {
	// contains filtered or unexported fields
}

func NewListBuilder

func NewListBuilder(mem memory.Allocator, etype arrow.DataType) *ListBuilder

NewListBuilder returns a builder, using the provided memory allocator. The created list builder will create a list whose elements will be of type etype.

func NewListBuilderWithField

func NewListBuilderWithField(mem memory.Allocator, field arrow.Field) *ListBuilder

NewListBuilderWithField takes a field to use for the child rather than just a datatype to allow for more customization.

func (*ListBuilder) Append

func (b *ListBuilder) Append(v bool)

func (*ListBuilder) AppendEmptyValue

func (b *ListBuilder) AppendEmptyValue()

func (*ListBuilder) AppendEmptyValues

func (b *ListBuilder) AppendEmptyValues(n int)

func (*ListBuilder) AppendNull

func (b *ListBuilder) AppendNull()

func (*ListBuilder) AppendNulls

func (b *ListBuilder) AppendNulls(n int)

func (*ListBuilder) AppendValueFromString

func (b *ListBuilder) AppendValueFromString(s string) error

func (*ListBuilder) AppendValues

func (b *ListBuilder) AppendValues(offsets []int32, valid []bool)

func (*ListBuilder) AppendWithSize

func (b *ListBuilder) AppendWithSize(v bool, _ int)

func (*ListBuilder) NewArray

func (b *ListBuilder) NewArray() arrow.Array

NewArray creates a List array from the memory buffers used by the builder and resets the ListBuilder so it can be used to build a new array.

func (*ListBuilder) NewListArray

func (b *ListBuilder) NewListArray() (a *List)

NewListArray creates a List array from the memory buffers used by the builder and resets the ListBuilder so it can be used to build a new array.

func (*ListBuilder) Release

func (b *ListBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*ListBuilder) Reserve

func (b *ListBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*ListBuilder) Resize

func (b *ListBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*ListBuilder) Type

func (b *ListBuilder) Type() arrow.DataType

func (*ListBuilder) Unmarshal

func (b *ListBuilder) Unmarshal(dec *json.Decoder) error

func (*ListBuilder) UnmarshalJSON

func (b *ListBuilder) UnmarshalJSON(data []byte) error

func (*ListBuilder) UnmarshalOne

func (b *ListBuilder) UnmarshalOne(dec *json.Decoder) error

func (*ListBuilder) ValueBuilder

func (b *ListBuilder) ValueBuilder() Builder

type ListLike

type ListLike interface {
	arrow.Array
	ListValues() arrow.Array
	ValueOffsets(i int) (start, end int64)
}

type ListLikeBuilder

type ListLikeBuilder interface {
	Builder
	ValueBuilder() Builder
	Append(bool)
}

type ListView

type ListView struct {
	// contains filtered or unexported fields
}

ListView represents an immutable sequence of array values defined by an offset into a child array and a length.

func NewListViewData

func NewListViewData(data arrow.ArrayData) *ListView

func (*ListView) Data

func (a *ListView) Data() arrow.ArrayData

func (*ListView) DataType

func (a *ListView) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*ListView) GetOneForMarshal

func (a *ListView) GetOneForMarshal(i int) interface{}

func (*ListView) IsNull

func (a *ListView) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*ListView) IsValid

func (a *ListView) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*ListView) Len

func (a *ListView) Len() int

Len returns the number of elements in the array.

func (*ListView) ListValues

func (a *ListView) ListValues() arrow.Array

func (*ListView) MarshalJSON

func (a *ListView) MarshalJSON() ([]byte, error)

func (*ListView) NullBitmapBytes

func (a *ListView) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*ListView) NullN

func (a *ListView) NullN() int

NullN returns the number of null values in the array.

func (*ListView) Offset

func (a *ListView) Offset() int

func (*ListView) Offsets

func (a *ListView) Offsets() []int32

func (*ListView) Release

func (a *ListView) Release()

func (*ListView) Retain

func (a *ListView) Retain()

func (*ListView) Sizes

func (a *ListView) Sizes() []int32

func (*ListView) String

func (a *ListView) String() string

func (*ListView) Validate

func (a *ListView) Validate() error

func (*ListView) ValidateFull

func (a *ListView) ValidateFull() error

func (*ListView) ValueOffsets

func (a *ListView) ValueOffsets(i int) (start, end int64)

func (*ListView) ValueStr

func (a *ListView) ValueStr(i int) string

type ListViewBuilder

type ListViewBuilder struct {
	// contains filtered or unexported fields
}

func NewListViewBuilder

func NewListViewBuilder(mem memory.Allocator, etype arrow.DataType) *ListViewBuilder

NewListViewBuilder returns a builder, using the provided memory allocator. The created list-view builder will create a list whose elements will be of type etype.

func NewListViewBuilderWithField

func NewListViewBuilderWithField(mem memory.Allocator, field arrow.Field) *ListViewBuilder

NewListViewBuilderWithField takes a field to use for the child rather than just a datatype to allow for more customization.

func (*ListViewBuilder) Append

func (b *ListViewBuilder) Append(v bool)

func (*ListViewBuilder) AppendDimensions

func (b *ListViewBuilder) AppendDimensions(offset int, listSize int)

func (*ListViewBuilder) AppendEmptyValue

func (b *ListViewBuilder) AppendEmptyValue()

func (*ListViewBuilder) AppendEmptyValues

func (b *ListViewBuilder) AppendEmptyValues(n int)

func (*ListViewBuilder) AppendNull

func (b *ListViewBuilder) AppendNull()

func (*ListViewBuilder) AppendNulls

func (b *ListViewBuilder) AppendNulls(n int)

func (*ListViewBuilder) AppendValueFromString

func (b *ListViewBuilder) AppendValueFromString(s string) error

func (*ListViewBuilder) AppendValuesWithSizes

func (b *ListViewBuilder) AppendValuesWithSizes(offsets []int32, sizes []int32, valid []bool)

func (*ListViewBuilder) AppendWithSize

func (b *ListViewBuilder) AppendWithSize(v bool, listSize int)

func (*ListViewBuilder) NewArray

func (b *ListViewBuilder) NewArray() arrow.Array

NewArray creates a ListView array from the memory buffers used by the builder and resets the ListViewBuilder so it can be used to build a new array.

func (*ListViewBuilder) NewListViewArray

func (b *ListViewBuilder) NewListViewArray() (a *ListView)

NewListViewArray creates a ListView array from the memory buffers used by the builder and resets the ListViewBuilder so it can be used to build a new array.

func (*ListViewBuilder) Release

func (b *ListViewBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*ListViewBuilder) Reserve

func (b *ListViewBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*ListViewBuilder) Resize

func (b *ListViewBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*ListViewBuilder) Type

func (b *ListViewBuilder) Type() arrow.DataType

func (*ListViewBuilder) Unmarshal

func (b *ListViewBuilder) Unmarshal(dec *json.Decoder) error

func (*ListViewBuilder) UnmarshalJSON

func (b *ListViewBuilder) UnmarshalJSON(data []byte) error

func (*ListViewBuilder) UnmarshalOne

func (b *ListViewBuilder) UnmarshalOne(dec *json.Decoder) error

func (*ListViewBuilder) ValueBuilder

func (b *ListViewBuilder) ValueBuilder() Builder

type Map

type Map struct {
	*List
	// contains filtered or unexported fields
}

Map represents an immutable sequence of Key/Value structs. It is a logical type that is implemented as a List<Struct: key, value>.

func NewMapData

func NewMapData(data arrow.ArrayData) *Map

NewMapData returns a new Map array value, from data

func (Map) Data

func (a Map) Data() arrow.ArrayData

func (Map) DataType

func (a Map) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (Map) IsNull

func (a Map) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (Map) IsValid

func (a Map) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Map) Items

func (a *Map) Items() arrow.Array

Items returns the full Array of Item values, equivalent to grabbing the Value field (the second field) of the child struct.

func (*Map) Keys

func (a *Map) Keys() arrow.Array

Keys returns the full Array of Key values, equivalent to grabbing the key field of the child struct.

func (*Map) KeysSorted

func (a *Map) KeysSorted() bool

KeysSorted checks the datatype that was used to construct this array and returns the KeysSorted boolean value used to denote if the key array is sorted for each list element.

Important note: Nothing is enforced regarding the KeysSorted value, it is solely a metadata field that should be set if keys within each value are sorted. This value is not used at all in regards to comparisons / equality.

func (Map) NullBitmapBytes

func (a Map) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (Map) NullN

func (a Map) NullN() int

NullN returns the number of null values in the array.

func (Map) Offset

func (a Map) Offset() int

func (*Map) Release

func (a *Map) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Map) Retain

func (a *Map) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

type MapBuilder

type MapBuilder struct {
	// contains filtered or unexported fields
}

func NewMapBuilder

func NewMapBuilder(mem memory.Allocator, keytype, itemtype arrow.DataType, keysSorted bool) *MapBuilder

NewMapBuilder returns a builder, using the provided memory allocator. The created Map builder will create a map array whose keys will be a non-nullable array of type `keytype` and whose mapped items will be a nullable array of itemtype.

KeysSorted is not enforced at all by the builder, it should only be set to true building using keys in sorted order for each value. The KeysSorted value will just be used when creating the DataType for the map.

Example

Simple example provided of converting a []map[string]int32 to an array.Map by using a MapBuilder:

/* assume maplist == []map[string]int32 */
bldr := array.NewMapBuilder(memory.DefaultAllocator, arrow.BinaryTypes.String, arrow.PrimitiveTypes.Int32, false)
defer bldr.Release()
kb := bldr.KeyBuilder().(*array.StringBuilder)
ib := bldr.ItemBuilder().(*array.Int32Builder)
for _, m := range maplist {
    bldr.Append(true)
    for k, v := range m {
         kb.Append(k)
         ib.Append(v)
    }
}
maparr := bldr.NewMapArray()
defer maparr.Release()

func NewMapBuilderWithType

func NewMapBuilderWithType(mem memory.Allocator, dt *arrow.MapType) *MapBuilder

func (*MapBuilder) Append

func (b *MapBuilder) Append(v bool)

Append adds a new Map element to the array, calling Append(false) is equivalent to calling AppendNull.

func (*MapBuilder) AppendEmptyValue

func (b *MapBuilder) AppendEmptyValue()

func (*MapBuilder) AppendEmptyValues

func (b *MapBuilder) AppendEmptyValues(n int)

func (*MapBuilder) AppendNull

func (b *MapBuilder) AppendNull()

AppendNull adds a null map entry to the array.

func (*MapBuilder) AppendNulls

func (b *MapBuilder) AppendNulls(n int)

AppendNulls adds null map entry to the array.

func (*MapBuilder) AppendValueFromString

func (b *MapBuilder) AppendValueFromString(s string) error

func (*MapBuilder) AppendValues

func (b *MapBuilder) AppendValues(offsets []int32, valid []bool)

AppendValues is for bulk appending a group of elements with offsets provided and validity booleans provided.

func (*MapBuilder) AppendWithSize

func (b *MapBuilder) AppendWithSize(v bool, _ int)

func (*MapBuilder) Cap

func (b *MapBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*MapBuilder) IsNull

func (b *MapBuilder) IsNull(i int) bool

IsNull returns if a previously appended value at a given index is null or not.

func (*MapBuilder) ItemBuilder

func (b *MapBuilder) ItemBuilder() Builder

ItemBuilder returns a builder that can be used to populate the values that the keys point to.

func (*MapBuilder) KeyBuilder

func (b *MapBuilder) KeyBuilder() Builder

KeyBuilder returns a builder that can be used to populate the keys of the maps.

func (*MapBuilder) Len

func (b *MapBuilder) Len() int

Len returns the current number of Maps that are in the builder

func (*MapBuilder) NewArray

func (b *MapBuilder) NewArray() arrow.Array

NewArray creates a new Map array from the memory buffers used by the builder, and resets the builder so it can be used again to build a new Map array.

func (*MapBuilder) NewMapArray

func (b *MapBuilder) NewMapArray() (a *Map)

NewMapArray creates a new Map array from the memory buffers used by the builder, and resets the builder so it can be used again to build a new Map array.

func (*MapBuilder) NullN

func (b *MapBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*MapBuilder) Release

func (b *MapBuilder) Release()

Release decreases the reference count by 1 for the sub builders (list, key, item).

func (*MapBuilder) Reserve

func (b *MapBuilder) Reserve(n int)

Reserve enough space for n maps

func (*MapBuilder) Resize

func (b *MapBuilder) Resize(n int)

Resize adjust the space allocated by b to n map elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may be reduced.

func (*MapBuilder) Retain

func (b *MapBuilder) Retain()

Retain increases the reference count by 1 for the sub-builders (list, key, item). Retain may be called simultaneously from multiple goroutines.

func (*MapBuilder) SetNull

func (b *MapBuilder) SetNull(i int)

func (*MapBuilder) Type

func (b *MapBuilder) Type() arrow.DataType

func (*MapBuilder) Unmarshal

func (b *MapBuilder) Unmarshal(dec *json.Decoder) error

func (*MapBuilder) UnmarshalJSON

func (b *MapBuilder) UnmarshalJSON(data []byte) error

func (*MapBuilder) UnmarshalOne

func (b *MapBuilder) UnmarshalOne(dec *json.Decoder) error

func (*MapBuilder) UnsafeAppendBoolToBitmap

func (b *MapBuilder) UnsafeAppendBoolToBitmap(v bool)

func (*MapBuilder) ValueBuilder

func (b *MapBuilder) ValueBuilder() Builder

ValueBuilder can be used instead of separately using the Key/Item builders to build the list as a List of Structs rather than building the keys/items separately.

type MonthDayNanoDictionaryBuilder

type MonthDayNanoDictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*MonthDayNanoDictionaryBuilder) Append

func (*MonthDayNanoDictionaryBuilder) AppendArray

func (b *MonthDayNanoDictionaryBuilder) AppendArray(arr arrow.Array) error

func (*MonthDayNanoDictionaryBuilder) AppendEmptyValue

func (b *MonthDayNanoDictionaryBuilder) AppendEmptyValue()

func (*MonthDayNanoDictionaryBuilder) AppendEmptyValues

func (b *MonthDayNanoDictionaryBuilder) AppendEmptyValues(n int)

func (*MonthDayNanoDictionaryBuilder) AppendIndices

func (b *MonthDayNanoDictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*MonthDayNanoDictionaryBuilder) AppendNull

func (b *MonthDayNanoDictionaryBuilder) AppendNull()

func (*MonthDayNanoDictionaryBuilder) AppendNulls

func (b *MonthDayNanoDictionaryBuilder) AppendNulls(n int)

func (*MonthDayNanoDictionaryBuilder) AppendValueFromString

func (b *MonthDayNanoDictionaryBuilder) AppendValueFromString(s string) error

func (*MonthDayNanoDictionaryBuilder) Cap

func (b *MonthDayNanoDictionaryBuilder) Cap() int

func (*MonthDayNanoDictionaryBuilder) DictionarySize

func (b *MonthDayNanoDictionaryBuilder) DictionarySize() int

func (*MonthDayNanoDictionaryBuilder) IndexBuilder

func (b *MonthDayNanoDictionaryBuilder) IndexBuilder() IndexBuilder

func (*MonthDayNanoDictionaryBuilder) InsertDictValues

func (b *MonthDayNanoDictionaryBuilder) InsertDictValues(arr *MonthDayNanoInterval) (err error)

func (*MonthDayNanoDictionaryBuilder) IsNull

func (b *MonthDayNanoDictionaryBuilder) IsNull(i int) bool

func (*MonthDayNanoDictionaryBuilder) NewArray

func (b *MonthDayNanoDictionaryBuilder) NewArray() arrow.Array

func (*MonthDayNanoDictionaryBuilder) NewDelta

func (b *MonthDayNanoDictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*MonthDayNanoDictionaryBuilder) NewDictionaryArray

func (b *MonthDayNanoDictionaryBuilder) NewDictionaryArray() *Dictionary

func (*MonthDayNanoDictionaryBuilder) Release

func (b *MonthDayNanoDictionaryBuilder) Release()

func (*MonthDayNanoDictionaryBuilder) Reserve

func (b *MonthDayNanoDictionaryBuilder) Reserve(n int)

func (*MonthDayNanoDictionaryBuilder) ResetFull

func (b *MonthDayNanoDictionaryBuilder) ResetFull()

func (*MonthDayNanoDictionaryBuilder) Resize

func (b *MonthDayNanoDictionaryBuilder) Resize(n int)

func (*MonthDayNanoDictionaryBuilder) Type

func (b *MonthDayNanoDictionaryBuilder) Type() arrow.DataType

func (*MonthDayNanoDictionaryBuilder) Unmarshal

func (b *MonthDayNanoDictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*MonthDayNanoDictionaryBuilder) UnmarshalJSON

func (b *MonthDayNanoDictionaryBuilder) UnmarshalJSON(data []byte) error

func (*MonthDayNanoDictionaryBuilder) UnmarshalOne

func (b *MonthDayNanoDictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type MonthDayNanoInterval

type MonthDayNanoInterval struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of arrow.DayTimeInterval values.

func NewMonthDayNanoIntervalData

func NewMonthDayNanoIntervalData(data arrow.ArrayData) *MonthDayNanoInterval

func (*MonthDayNanoInterval) Data

func (a *MonthDayNanoInterval) Data() arrow.ArrayData

func (*MonthDayNanoInterval) DataType

func (a *MonthDayNanoInterval) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*MonthDayNanoInterval) GetOneForMarshal

func (a *MonthDayNanoInterval) GetOneForMarshal(i int) interface{}

func (*MonthDayNanoInterval) IsNull

func (a *MonthDayNanoInterval) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*MonthDayNanoInterval) IsValid

func (a *MonthDayNanoInterval) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*MonthDayNanoInterval) Len

func (a *MonthDayNanoInterval) Len() int

Len returns the number of elements in the array.

func (*MonthDayNanoInterval) MarshalJSON

func (a *MonthDayNanoInterval) MarshalJSON() ([]byte, error)

MarshalJSON will marshal this array to a JSON array with elements marshalled to the form {"months": #, "days": #, "nanoseconds": #}

func (*MonthDayNanoInterval) MonthDayNanoIntervalValues

func (a *MonthDayNanoInterval) MonthDayNanoIntervalValues() []arrow.MonthDayNanoInterval

func (*MonthDayNanoInterval) NullBitmapBytes

func (a *MonthDayNanoInterval) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*MonthDayNanoInterval) NullN

func (a *MonthDayNanoInterval) NullN() int

NullN returns the number of null values in the array.

func (*MonthDayNanoInterval) Offset

func (a *MonthDayNanoInterval) Offset() int

func (*MonthDayNanoInterval) Release

func (a *MonthDayNanoInterval) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*MonthDayNanoInterval) Retain

func (a *MonthDayNanoInterval) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*MonthDayNanoInterval) String

func (a *MonthDayNanoInterval) String() string

func (*MonthDayNanoInterval) Value

func (*MonthDayNanoInterval) ValueStr

func (a *MonthDayNanoInterval) ValueStr(i int) string

type MonthDayNanoIntervalBuilder

type MonthDayNanoIntervalBuilder struct {
	// contains filtered or unexported fields
}

func NewMonthDayNanoIntervalBuilder

func NewMonthDayNanoIntervalBuilder(mem memory.Allocator) *MonthDayNanoIntervalBuilder

func (*MonthDayNanoIntervalBuilder) Append

func (*MonthDayNanoIntervalBuilder) AppendEmptyValue

func (b *MonthDayNanoIntervalBuilder) AppendEmptyValue()

func (*MonthDayNanoIntervalBuilder) AppendEmptyValues

func (b *MonthDayNanoIntervalBuilder) AppendEmptyValues(n int)

func (*MonthDayNanoIntervalBuilder) AppendNull

func (b *MonthDayNanoIntervalBuilder) AppendNull()

func (*MonthDayNanoIntervalBuilder) AppendNulls

func (b *MonthDayNanoIntervalBuilder) AppendNulls(n int)

func (*MonthDayNanoIntervalBuilder) AppendValueFromString

func (b *MonthDayNanoIntervalBuilder) AppendValueFromString(s string) error

func (*MonthDayNanoIntervalBuilder) AppendValues

func (b *MonthDayNanoIntervalBuilder) AppendValues(v []arrow.MonthDayNanoInterval, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*MonthDayNanoIntervalBuilder) Cap

func (b *MonthDayNanoIntervalBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*MonthDayNanoIntervalBuilder) IsNull

func (b *MonthDayNanoIntervalBuilder) IsNull(i int) bool

func (*MonthDayNanoIntervalBuilder) Len

func (b *MonthDayNanoIntervalBuilder) Len() int

Len returns the number of elements in the array builder.

func (*MonthDayNanoIntervalBuilder) NewArray

func (b *MonthDayNanoIntervalBuilder) NewArray() arrow.Array

NewArray creates a MonthDayNanoInterval array from the memory buffers used by the builder and resets the MonthDayNanoIntervalBuilder so it can be used to build a new array.

func (*MonthDayNanoIntervalBuilder) NewMonthDayNanoIntervalArray

func (b *MonthDayNanoIntervalBuilder) NewMonthDayNanoIntervalArray() (a *MonthDayNanoInterval)

NewMonthDayNanoIntervalArray creates a MonthDayNanoInterval array from the memory buffers used by the builder and resets the MonthDayNanoIntervalBuilder so it can be used to build a new array.

func (*MonthDayNanoIntervalBuilder) NullN

func (b *MonthDayNanoIntervalBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*MonthDayNanoIntervalBuilder) Release

func (b *MonthDayNanoIntervalBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*MonthDayNanoIntervalBuilder) Reserve

func (b *MonthDayNanoIntervalBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*MonthDayNanoIntervalBuilder) Resize

func (b *MonthDayNanoIntervalBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*MonthDayNanoIntervalBuilder) Retain

func (b *MonthDayNanoIntervalBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*MonthDayNanoIntervalBuilder) SetNull

func (b *MonthDayNanoIntervalBuilder) SetNull(i int)

func (*MonthDayNanoIntervalBuilder) Type

func (*MonthDayNanoIntervalBuilder) Unmarshal

func (b *MonthDayNanoIntervalBuilder) Unmarshal(dec *json.Decoder) error

func (*MonthDayNanoIntervalBuilder) UnmarshalJSON

func (b *MonthDayNanoIntervalBuilder) UnmarshalJSON(data []byte) error

UnmarshalJSON unmarshals a JSON array of objects and adds them to this builder, each element of the array is expected to be an object of the form {"months": #, "days": #, "nanoseconds": #}

func (*MonthDayNanoIntervalBuilder) UnmarshalOne

func (b *MonthDayNanoIntervalBuilder) UnmarshalOne(dec *json.Decoder) error

func (*MonthDayNanoIntervalBuilder) UnsafeAppend

func (*MonthDayNanoIntervalBuilder) UnsafeAppendBoolToBitmap

func (b *MonthDayNanoIntervalBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type MonthInterval

type MonthInterval struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of arrow.MonthInterval values.

func NewMonthIntervalData

func NewMonthIntervalData(data arrow.ArrayData) *MonthInterval

func (*MonthInterval) Data

func (a *MonthInterval) Data() arrow.ArrayData

func (*MonthInterval) DataType

func (a *MonthInterval) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*MonthInterval) GetOneForMarshal

func (a *MonthInterval) GetOneForMarshal(i int) interface{}

func (*MonthInterval) IsNull

func (a *MonthInterval) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*MonthInterval) IsValid

func (a *MonthInterval) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*MonthInterval) Len

func (a *MonthInterval) Len() int

Len returns the number of elements in the array.

func (*MonthInterval) MarshalJSON

func (a *MonthInterval) MarshalJSON() ([]byte, error)

MarshalJSON will create a json array out of a MonthInterval array, each value will be an object of the form {"months": #} where # is the numeric value of that index

func (*MonthInterval) MonthIntervalValues

func (a *MonthInterval) MonthIntervalValues() []arrow.MonthInterval

func (*MonthInterval) NullBitmapBytes

func (a *MonthInterval) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*MonthInterval) NullN

func (a *MonthInterval) NullN() int

NullN returns the number of null values in the array.

func (*MonthInterval) Offset

func (a *MonthInterval) Offset() int

func (*MonthInterval) Release

func (a *MonthInterval) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*MonthInterval) Retain

func (a *MonthInterval) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*MonthInterval) String

func (a *MonthInterval) String() string

func (*MonthInterval) Value

func (a *MonthInterval) Value(i int) arrow.MonthInterval

func (*MonthInterval) ValueStr

func (a *MonthInterval) ValueStr(i int) string

type MonthIntervalBuilder

type MonthIntervalBuilder struct {
	// contains filtered or unexported fields
}

func NewMonthIntervalBuilder

func NewMonthIntervalBuilder(mem memory.Allocator) *MonthIntervalBuilder

func (*MonthIntervalBuilder) Append

func (*MonthIntervalBuilder) AppendEmptyValue

func (b *MonthIntervalBuilder) AppendEmptyValue()

func (*MonthIntervalBuilder) AppendEmptyValues

func (b *MonthIntervalBuilder) AppendEmptyValues(n int)

func (*MonthIntervalBuilder) AppendNull

func (b *MonthIntervalBuilder) AppendNull()

func (*MonthIntervalBuilder) AppendNulls

func (b *MonthIntervalBuilder) AppendNulls(n int)

func (*MonthIntervalBuilder) AppendValueFromString

func (b *MonthIntervalBuilder) AppendValueFromString(s string) error

func (*MonthIntervalBuilder) AppendValues

func (b *MonthIntervalBuilder) AppendValues(v []arrow.MonthInterval, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*MonthIntervalBuilder) Cap

func (b *MonthIntervalBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*MonthIntervalBuilder) IsNull

func (b *MonthIntervalBuilder) IsNull(i int) bool

func (*MonthIntervalBuilder) Len

func (b *MonthIntervalBuilder) Len() int

Len returns the number of elements in the array builder.

func (*MonthIntervalBuilder) NewArray

func (b *MonthIntervalBuilder) NewArray() arrow.Array

NewArray creates a MonthInterval array from the memory buffers used by the builder and resets the MonthIntervalBuilder so it can be used to build a new array.

func (*MonthIntervalBuilder) NewMonthIntervalArray

func (b *MonthIntervalBuilder) NewMonthIntervalArray() (a *MonthInterval)

NewMonthIntervalArray creates a MonthInterval array from the memory buffers used by the builder and resets the MonthIntervalBuilder so it can be used to build a new array.

func (*MonthIntervalBuilder) NullN

func (b *MonthIntervalBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*MonthIntervalBuilder) Release

func (b *MonthIntervalBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*MonthIntervalBuilder) Reserve

func (b *MonthIntervalBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*MonthIntervalBuilder) Resize

func (b *MonthIntervalBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*MonthIntervalBuilder) Retain

func (b *MonthIntervalBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*MonthIntervalBuilder) SetNull

func (b *MonthIntervalBuilder) SetNull(i int)

func (*MonthIntervalBuilder) Type

func (*MonthIntervalBuilder) Unmarshal

func (b *MonthIntervalBuilder) Unmarshal(dec *json.Decoder) error

func (*MonthIntervalBuilder) UnmarshalJSON

func (b *MonthIntervalBuilder) UnmarshalJSON(data []byte) error

UnmarshalJSON will add the unmarshalled values of an array to the builder, values are expected to be strings of the form "#months" where # is the int32 value that will be added to the builder.

func (*MonthIntervalBuilder) UnmarshalOne

func (b *MonthIntervalBuilder) UnmarshalOne(dec *json.Decoder) error

func (*MonthIntervalBuilder) UnsafeAppend

func (b *MonthIntervalBuilder) UnsafeAppend(v arrow.MonthInterval)

func (*MonthIntervalBuilder) UnsafeAppendBoolToBitmap

func (b *MonthIntervalBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type MonthIntervalDictionaryBuilder

type MonthIntervalDictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*MonthIntervalDictionaryBuilder) Append

func (*MonthIntervalDictionaryBuilder) AppendArray

func (b *MonthIntervalDictionaryBuilder) AppendArray(arr arrow.Array) error

func (*MonthIntervalDictionaryBuilder) AppendEmptyValue

func (b *MonthIntervalDictionaryBuilder) AppendEmptyValue()

func (*MonthIntervalDictionaryBuilder) AppendEmptyValues

func (b *MonthIntervalDictionaryBuilder) AppendEmptyValues(n int)

func (*MonthIntervalDictionaryBuilder) AppendIndices

func (b *MonthIntervalDictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*MonthIntervalDictionaryBuilder) AppendNull

func (b *MonthIntervalDictionaryBuilder) AppendNull()

func (*MonthIntervalDictionaryBuilder) AppendNulls

func (b *MonthIntervalDictionaryBuilder) AppendNulls(n int)

func (*MonthIntervalDictionaryBuilder) AppendValueFromString

func (b *MonthIntervalDictionaryBuilder) AppendValueFromString(s string) error

func (*MonthIntervalDictionaryBuilder) Cap

func (b *MonthIntervalDictionaryBuilder) Cap() int

func (*MonthIntervalDictionaryBuilder) DictionarySize

func (b *MonthIntervalDictionaryBuilder) DictionarySize() int

func (*MonthIntervalDictionaryBuilder) IndexBuilder

func (b *MonthIntervalDictionaryBuilder) IndexBuilder() IndexBuilder

func (*MonthIntervalDictionaryBuilder) InsertDictValues

func (b *MonthIntervalDictionaryBuilder) InsertDictValues(arr *MonthInterval) (err error)

func (*MonthIntervalDictionaryBuilder) IsNull

func (b *MonthIntervalDictionaryBuilder) IsNull(i int) bool

func (*MonthIntervalDictionaryBuilder) NewArray

func (b *MonthIntervalDictionaryBuilder) NewArray() arrow.Array

func (*MonthIntervalDictionaryBuilder) NewDelta

func (b *MonthIntervalDictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*MonthIntervalDictionaryBuilder) NewDictionaryArray

func (b *MonthIntervalDictionaryBuilder) NewDictionaryArray() *Dictionary

func (*MonthIntervalDictionaryBuilder) Release

func (b *MonthIntervalDictionaryBuilder) Release()

func (*MonthIntervalDictionaryBuilder) Reserve

func (b *MonthIntervalDictionaryBuilder) Reserve(n int)

func (*MonthIntervalDictionaryBuilder) ResetFull

func (b *MonthIntervalDictionaryBuilder) ResetFull()

func (*MonthIntervalDictionaryBuilder) Resize

func (b *MonthIntervalDictionaryBuilder) Resize(n int)

func (*MonthIntervalDictionaryBuilder) Type

func (b *MonthIntervalDictionaryBuilder) Type() arrow.DataType

func (*MonthIntervalDictionaryBuilder) Unmarshal

func (b *MonthIntervalDictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*MonthIntervalDictionaryBuilder) UnmarshalJSON

func (b *MonthIntervalDictionaryBuilder) UnmarshalJSON(data []byte) error

func (*MonthIntervalDictionaryBuilder) UnmarshalOne

func (b *MonthIntervalDictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Null

type Null struct {
	// contains filtered or unexported fields
}

Null represents an immutable, degenerate array with no physical storage.

func NewNull

func NewNull(n int) *Null

NewNull returns a new Null array value of size n.

func NewNullData

func NewNullData(data arrow.ArrayData) *Null

NewNullData returns a new Null array value, from data.

func (*Null) Data

func (a *Null) Data() arrow.ArrayData

func (*Null) DataType

func (a *Null) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Null) GetOneForMarshal

func (a *Null) GetOneForMarshal(i int) interface{}

func (*Null) IsNull

func (a *Null) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Null) IsValid

func (a *Null) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Null) Len

func (a *Null) Len() int

Len returns the number of elements in the array.

func (*Null) MarshalJSON

func (a *Null) MarshalJSON() ([]byte, error)

func (*Null) NullBitmapBytes

func (a *Null) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Null) NullN

func (a *Null) NullN() int

NullN returns the number of null values in the array.

func (*Null) Offset

func (a *Null) Offset() int

func (*Null) Release

func (a *Null) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Null) Retain

func (a *Null) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Null) String

func (a *Null) String() string

func (*Null) Value

func (a *Null) Value(int) interface{}

func (*Null) ValueStr

func (a *Null) ValueStr(int) string

type NullBuilder

type NullBuilder struct {
	// contains filtered or unexported fields
}

func NewNullBuilder

func NewNullBuilder(mem memory.Allocator) *NullBuilder

NewNullBuilder returns a builder, using the provided memory allocator.

func (*NullBuilder) AppendEmptyValue

func (b *NullBuilder) AppendEmptyValue()

func (*NullBuilder) AppendEmptyValues

func (b *NullBuilder) AppendEmptyValues(n int)

func (*NullBuilder) AppendNull

func (b *NullBuilder) AppendNull()

func (*NullBuilder) AppendNulls

func (b *NullBuilder) AppendNulls(n int)

func (*NullBuilder) AppendValueFromString

func (b *NullBuilder) AppendValueFromString(s string) error

func (*NullBuilder) Cap

func (b *NullBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*NullBuilder) IsNull

func (b *NullBuilder) IsNull(i int) bool

func (*NullBuilder) Len

func (b *NullBuilder) Len() int

Len returns the number of elements in the array builder.

func (*NullBuilder) NewArray

func (b *NullBuilder) NewArray() arrow.Array

NewArray creates a Null array from the memory buffers used by the builder and resets the NullBuilder so it can be used to build a new array.

func (*NullBuilder) NewNullArray

func (b *NullBuilder) NewNullArray() (a *Null)

NewNullArray creates a Null array from the memory buffers used by the builder and resets the NullBuilder so it can be used to build a new array.

func (*NullBuilder) NullN

func (b *NullBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*NullBuilder) Release

func (b *NullBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*NullBuilder) Reserve

func (*NullBuilder) Reserve(size int)

func (*NullBuilder) Resize

func (*NullBuilder) Resize(size int)

func (*NullBuilder) Retain

func (b *NullBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*NullBuilder) SetNull

func (b *NullBuilder) SetNull(i int)

func (*NullBuilder) Type

func (b *NullBuilder) Type() arrow.DataType

func (*NullBuilder) Unmarshal

func (b *NullBuilder) Unmarshal(dec *json.Decoder) error

func (*NullBuilder) UnmarshalJSON

func (b *NullBuilder) UnmarshalJSON(data []byte) error

func (*NullBuilder) UnmarshalOne

func (b *NullBuilder) UnmarshalOne(dec *json.Decoder) error

func (*NullBuilder) UnsafeAppendBoolToBitmap

func (b *NullBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type NullDictionaryBuilder

type NullDictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*NullDictionaryBuilder) AppendArray

func (b *NullDictionaryBuilder) AppendArray(arr arrow.Array) error

func (*NullDictionaryBuilder) AppendEmptyValue

func (b *NullDictionaryBuilder) AppendEmptyValue()

func (*NullDictionaryBuilder) AppendEmptyValues

func (b *NullDictionaryBuilder) AppendEmptyValues(n int)

func (*NullDictionaryBuilder) AppendIndices

func (b *NullDictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*NullDictionaryBuilder) AppendNull

func (b *NullDictionaryBuilder) AppendNull()

func (*NullDictionaryBuilder) AppendNulls

func (b *NullDictionaryBuilder) AppendNulls(n int)

func (*NullDictionaryBuilder) AppendValueFromString

func (b *NullDictionaryBuilder) AppendValueFromString(s string) error

func (*NullDictionaryBuilder) Cap

func (b *NullDictionaryBuilder) Cap() int

func (*NullDictionaryBuilder) DictionarySize

func (b *NullDictionaryBuilder) DictionarySize() int

func (*NullDictionaryBuilder) IndexBuilder

func (b *NullDictionaryBuilder) IndexBuilder() IndexBuilder

func (*NullDictionaryBuilder) IsNull

func (b *NullDictionaryBuilder) IsNull(i int) bool

func (*NullDictionaryBuilder) NewArray

func (b *NullDictionaryBuilder) NewArray() arrow.Array

func (*NullDictionaryBuilder) NewDelta

func (b *NullDictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*NullDictionaryBuilder) NewDictionaryArray

func (b *NullDictionaryBuilder) NewDictionaryArray() *Dictionary

func (*NullDictionaryBuilder) Release

func (b *NullDictionaryBuilder) Release()

func (*NullDictionaryBuilder) Reserve

func (b *NullDictionaryBuilder) Reserve(n int)

func (*NullDictionaryBuilder) ResetFull

func (b *NullDictionaryBuilder) ResetFull()

func (*NullDictionaryBuilder) Resize

func (b *NullDictionaryBuilder) Resize(n int)

func (*NullDictionaryBuilder) Type

func (b *NullDictionaryBuilder) Type() arrow.DataType

func (*NullDictionaryBuilder) Unmarshal

func (b *NullDictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*NullDictionaryBuilder) UnmarshalJSON

func (b *NullDictionaryBuilder) UnmarshalJSON(data []byte) error

func (*NullDictionaryBuilder) UnmarshalOne

func (b *NullDictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Option

type Option func(config)

func WithAllocator

func WithAllocator(mem memory.Allocator) Option

WithAllocator specifies the allocator to use for creating the record batches, if it is not called, then memory.DefaultAllocator will be used.

func WithChunk

func WithChunk(n int) Option

WithChunk sets the chunk size for reading in json records. The default is to read in one row per record batch as a single object. If chunk size is set to a negative value, then the entire file is read as a single record batch. Otherwise a record batch is read in with chunk size rows per record batch until it reaches EOF.

type RecordBuilder

type RecordBuilder struct {
	// contains filtered or unexported fields
}

RecordBuilder eases the process of building a Record, iteratively, from a known Schema.

func NewRecordBuilder

func NewRecordBuilder(mem memory.Allocator, schema *arrow.Schema) *RecordBuilder

NewRecordBuilder returns a builder, using the provided memory allocator and a schema.

func (*RecordBuilder) Field

func (b *RecordBuilder) Field(i int) Builder

func (*RecordBuilder) Fields

func (b *RecordBuilder) Fields() []Builder

func (*RecordBuilder) NewRecord

func (b *RecordBuilder) NewRecord() arrow.Record

NewRecord creates a new record from the memory buffers and resets the RecordBuilder so it can be used to build a new record.

The returned Record must be Release()'d after use.

NewRecord panics if the fields' builder do not have the same length.

func (*RecordBuilder) Release

func (b *RecordBuilder) Release()

Release decreases the reference count by 1.

func (*RecordBuilder) Reserve

func (b *RecordBuilder) Reserve(size int)

func (*RecordBuilder) Retain

func (b *RecordBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*RecordBuilder) Schema

func (b *RecordBuilder) Schema() *arrow.Schema

func (*RecordBuilder) UnmarshalJSON

func (b *RecordBuilder) UnmarshalJSON(data []byte) error

UnmarshalJSON for record builder will read in a single object and add the values to each field in the recordbuilder, missing fields will get a null and unexpected keys will be ignored. If reading in an array of records as a single batch, then use a structbuilder and use RecordFromStruct.

type RecordReader

type RecordReader interface {
	Retain()
	Release()

	Schema() *arrow.Schema

	Next() bool
	Record() arrow.Record
	Err() error
}

RecordReader reads a stream of records.

func NewRecordReader

func NewRecordReader(schema *arrow.Schema, recs []arrow.Record) (RecordReader, error)

NewRecordReader returns a simple iterator over the given slice of records.

type RunEndEncoded

type RunEndEncoded struct {
	// contains filtered or unexported fields
}

RunEndEncoded represents an array containing two children: an array of int32 values defining the ends of each run of values and an array of values

func NewRunEndEncodedArray

func NewRunEndEncodedArray(runEnds, values arrow.Array, logicalLength, offset int) *RunEndEncoded

func NewRunEndEncodedData

func NewRunEndEncodedData(data arrow.ArrayData) *RunEndEncoded

func (*RunEndEncoded) Data

func (a *RunEndEncoded) Data() arrow.ArrayData

func (*RunEndEncoded) DataType

func (a *RunEndEncoded) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*RunEndEncoded) GetOneForMarshal

func (r *RunEndEncoded) GetOneForMarshal(i int) interface{}

func (*RunEndEncoded) GetPhysicalIndex

func (r *RunEndEncoded) GetPhysicalIndex(i int) int

GetPhysicalIndex can be used to get the run-encoded value instead of costly LogicalValuesArray in the following way:

r.Values().(valuetype).Value(r.GetPhysicalIndex(i))

func (*RunEndEncoded) GetPhysicalLength

func (r *RunEndEncoded) GetPhysicalLength() int

func (*RunEndEncoded) GetPhysicalOffset

func (r *RunEndEncoded) GetPhysicalOffset() int

func (*RunEndEncoded) IsNull

func (a *RunEndEncoded) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*RunEndEncoded) IsValid

func (a *RunEndEncoded) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*RunEndEncoded) Len

func (a *RunEndEncoded) Len() int

Len returns the number of elements in the array.

func (*RunEndEncoded) LogicalRunEndsArray

func (r *RunEndEncoded) LogicalRunEndsArray(mem memory.Allocator) arrow.Array

LogicalRunEndsArray returns an array holding the logical indexes of each run end, only over the range of run end values relative to the logical offset/length range of the parent array.

For arrays with an offset, this is not a slice of the existing internal run ends array. Instead a new array is created with run-ends that are adjusted so the new array can have an offset of 0. As a result this method can be expensive to call for an array with a non-zero offset.

Example

For this array:

RunEndEncoded: { Offset: 150, Length: 1500 }
    RunEnds: [ 1, 2, 4, 6, 10, 1000, 1750, 2000 ]
    Values:  [ "a", "b", "c", "d", "e", "f", "g", "h" ]

LogicalRunEndsArray will return the following array:

[ 850, 1500 ]

This is because the offset of 150 tells us to skip all run-ends less than 150 (by finding the physical offset), and we adjust the run-ends accordingly (1000 - 150 = 850). The logical length of the array is 1500, so we know we don't want to go past the 1750 run end. Thus the last run-end is determined by doing: min(1750 - 150, 1500) = 1500.

Note

The return from this needs to be Released

func (*RunEndEncoded) LogicalValuesArray

func (r *RunEndEncoded) LogicalValuesArray() arrow.Array

LogicalValuesArray returns an array holding the values of each run, only over the range of run values inside the logical offset/length range of the parent array.

Example

For this array:

RunEndEncoded: { Offset: 150, Length: 1500 }
    RunEnds: [ 1, 2, 4, 6, 10, 1000, 1750, 2000 ]
    Values:  [ "a", "b", "c", "d", "e", "f", "g", "h" ]

LogicalValuesArray will return the following array:

[ "f", "g" ]

This is because the offset of 150 tells it to skip the values until "f" which corresponds with the logical offset (the run from 10 - 1000), and stops after "g" because the length + offset goes to 1650 which is within the run from 1000 - 1750, corresponding to the "g" value.

Note

The return from this needs to be Released.

func (*RunEndEncoded) MarshalJSON

func (r *RunEndEncoded) MarshalJSON() ([]byte, error)

func (*RunEndEncoded) NullBitmapBytes

func (a *RunEndEncoded) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*RunEndEncoded) NullN

func (a *RunEndEncoded) NullN() int

NullN returns the number of null values in the array.

func (*RunEndEncoded) Offset

func (a *RunEndEncoded) Offset() int

func (*RunEndEncoded) Release

func (r *RunEndEncoded) Release()

func (*RunEndEncoded) Retain

func (r *RunEndEncoded) Retain()

func (*RunEndEncoded) RunEndsArr

func (r *RunEndEncoded) RunEndsArr() arrow.Array

func (*RunEndEncoded) String

func (r *RunEndEncoded) String() string

func (*RunEndEncoded) ValueStr

func (r *RunEndEncoded) ValueStr(i int) string

ValueStr will return the str representation of the value at the logical offset i.

func (*RunEndEncoded) Values

func (r *RunEndEncoded) Values() arrow.Array

type RunEndEncodedBuilder

type RunEndEncodedBuilder struct {
	// contains filtered or unexported fields
}

func NewRunEndEncodedBuilder

func NewRunEndEncodedBuilder(mem memory.Allocator, runEnds, encoded arrow.DataType) *RunEndEncodedBuilder

func (*RunEndEncodedBuilder) Append

func (b *RunEndEncodedBuilder) Append(n uint64)

func (*RunEndEncodedBuilder) AppendEmptyValue

func (b *RunEndEncodedBuilder) AppendEmptyValue()

func (*RunEndEncodedBuilder) AppendEmptyValues

func (b *RunEndEncodedBuilder) AppendEmptyValues(n int)

func (*RunEndEncodedBuilder) AppendNull

func (b *RunEndEncodedBuilder) AppendNull()

func (*RunEndEncodedBuilder) AppendNulls

func (b *RunEndEncodedBuilder) AppendNulls(n int)

func (*RunEndEncodedBuilder) AppendRuns

func (b *RunEndEncodedBuilder) AppendRuns(runs []uint64)

func (*RunEndEncodedBuilder) AppendValueFromString

func (b *RunEndEncodedBuilder) AppendValueFromString(s string) error

AppendValueFromString can't be used in conjunction with UnmarshalOne

func (*RunEndEncodedBuilder) Cap

func (b *RunEndEncodedBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*RunEndEncodedBuilder) ContinueRun

func (b *RunEndEncodedBuilder) ContinueRun(n uint64)

func (*RunEndEncodedBuilder) IsNull

func (b *RunEndEncodedBuilder) IsNull(i int) bool

func (*RunEndEncodedBuilder) Len

func (b *RunEndEncodedBuilder) Len() int

Len returns the number of elements in the array builder.

func (*RunEndEncodedBuilder) NewArray

func (b *RunEndEncodedBuilder) NewArray() arrow.Array

func (*RunEndEncodedBuilder) NewRunEndEncodedArray

func (b *RunEndEncodedBuilder) NewRunEndEncodedArray() *RunEndEncoded

func (*RunEndEncodedBuilder) NullN

func (b *RunEndEncodedBuilder) NullN() int

func (*RunEndEncodedBuilder) Release

func (b *RunEndEncodedBuilder) Release()

func (*RunEndEncodedBuilder) Reserve

func (b *RunEndEncodedBuilder) Reserve(n int)

func (*RunEndEncodedBuilder) Resize

func (b *RunEndEncodedBuilder) Resize(n int)

func (*RunEndEncodedBuilder) Retain

func (b *RunEndEncodedBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*RunEndEncodedBuilder) SetNull

func (b *RunEndEncodedBuilder) SetNull(i int)

func (*RunEndEncodedBuilder) Type

func (*RunEndEncodedBuilder) Unmarshal

func (b *RunEndEncodedBuilder) Unmarshal(dec *json.Decoder) error

Unmarshal can't be used in conjunction with AppendValueFromString (as it calls UnmarshalOne)

func (*RunEndEncodedBuilder) UnmarshalJSON

func (b *RunEndEncodedBuilder) UnmarshalJSON(data []byte) error

UnmarshalJSON can't be used in conjunction with AppendValueFromString (as it calls UnmarshalOne)

func (*RunEndEncodedBuilder) UnmarshalOne

func (b *RunEndEncodedBuilder) UnmarshalOne(dec *json.Decoder) error

UnmarshalOne can't be used in conjunction with AppendValueFromString

func (*RunEndEncodedBuilder) UnsafeAppendBoolToBitmap

func (b *RunEndEncodedBuilder) UnsafeAppendBoolToBitmap(isValid bool)

func (*RunEndEncodedBuilder) ValueBuilder

func (b *RunEndEncodedBuilder) ValueBuilder() Builder

type SparseUnion

type SparseUnion struct {
	// contains filtered or unexported fields
}

SparseUnion represents an array where each logical value is taken from a single child. A buffer of 8-bit type ids indicates which child a given logical value is to be taken from. This is represented as the ChildID, which is the index into the list of children.

In a sparse union, each child array will have the same length as the union array itself, regardless of how many values in the union actually refer to it.

Unlike most other arrays, unions do not have a top-level validity bitmap.

func NewSparseUnion

func NewSparseUnion(dt *arrow.SparseUnionType, length int, children []arrow.Array, typeIDs *memory.Buffer, offset int) *SparseUnion

NewSparseUnion constructs a union array using the given type, length, list of children and buffer of typeIDs with the given offset.

func NewSparseUnionData

func NewSparseUnionData(data arrow.ArrayData) *SparseUnion

NewSparseUnionData constructs a SparseUnion array from the given ArrayData object.

func NewSparseUnionFromArrays

func NewSparseUnionFromArrays(typeIDs arrow.Array, children []arrow.Array, codes ...arrow.UnionTypeCode) (*SparseUnion, error)

NewSparseUnionFromArrays constructs a new SparseUnion array with the provided values.

typeIDs *must* be an INT8 array with no nulls len(codes) *must* be either 0 or equal to len(children). If len(codes) is 0, the type codes used will be sequentially numeric starting at 0.

func NewSparseUnionFromArraysWithFieldCodes

func NewSparseUnionFromArraysWithFieldCodes(typeIDs arrow.Array, children []arrow.Array, fields []string, codes []arrow.UnionTypeCode) (*SparseUnion, error)

NewSparseUnionFromArraysWithFieldCodes combines the other constructors for constructing a new SparseUnion array with the provided field names and type codes, along with children and type ids.

All the requirements mentioned in NewSparseUnionFromArrays and NewSparseUnionFromArraysWithFields apply.

func NewSparseUnionFromArraysWithFields

func NewSparseUnionFromArraysWithFields(typeIDs arrow.Array, children []arrow.Array, fields []string) (*SparseUnion, error)

NewSparseUnionFromArrayWithFields constructs a new SparseUnion array like NewSparseUnionFromArrays, but allows specifying the field names. Type codes will be auto-generated sequentially starting at 0.

typeIDs *must* be an INT8 array with no nulls. len(fields) *must* either be 0 or equal to len(children). If len(fields) is 0, then the fields will be named sequentially starting at "0".

func (*SparseUnion) ChildID

func (a *SparseUnion) ChildID(i int) int

func (*SparseUnion) Field

func (a *SparseUnion) Field(pos int) (result arrow.Array)

func (*SparseUnion) GetFlattenedField

func (a *SparseUnion) GetFlattenedField(mem memory.Allocator, index int) (arrow.Array, error)

GetFlattenedField returns a child array, adjusting its validity bitmap where the union array type codes don't match.

ie: the returned array will have a null in every index that it is not referenced by union.

func (*SparseUnion) GetOneForMarshal

func (a *SparseUnion) GetOneForMarshal(i int) interface{}

func (*SparseUnion) MarshalJSON

func (a *SparseUnion) MarshalJSON() ([]byte, error)

func (*SparseUnion) Mode

func (a *SparseUnion) Mode() arrow.UnionMode

func (*SparseUnion) NumFields

func (a *SparseUnion) NumFields() int

func (*SparseUnion) RawTypeCodes

func (a *SparseUnion) RawTypeCodes() []arrow.UnionTypeCode

func (*SparseUnion) Release

func (a *SparseUnion) Release()

func (*SparseUnion) Retain

func (a *SparseUnion) Retain()

func (*SparseUnion) String

func (a *SparseUnion) String() string

func (*SparseUnion) TypeCode

func (a *SparseUnion) TypeCode(i int) arrow.UnionTypeCode

func (*SparseUnion) TypeCodes

func (a *SparseUnion) TypeCodes() *memory.Buffer

func (*SparseUnion) UnionType

func (a *SparseUnion) UnionType() arrow.UnionType

func (*SparseUnion) Validate

func (a *SparseUnion) Validate() error

func (*SparseUnion) ValidateFull

func (a *SparseUnion) ValidateFull() error

func (*SparseUnion) ValueStr

func (a *SparseUnion) ValueStr(i int) string

type SparseUnionBuilder

type SparseUnionBuilder struct {
	// contains filtered or unexported fields
}

SparseUnionBuilder is used to build a Sparse Union array using the Append methods. You can also add new types to the union on the fly by using AppendChild.

Keep in mind: All children of a SparseUnion should be the same length as the union itself. If you add new children with AppendChild, ensure that they have the correct number of preceding elements that have been added to the builder beforehand.

Example
package main

import (
	"fmt"

	"github.com/apache/arrow/go/v17/arrow"
	"github.com/apache/arrow/go/v17/arrow/array"
	"github.com/apache/arrow/go/v17/arrow/memory"
)

func main() {
	dt1 := arrow.SparseUnionOf([]arrow.Field{
		{Name: "c", Type: &arrow.DictionaryType{IndexType: arrow.PrimitiveTypes.Uint16, ValueType: arrow.BinaryTypes.String}},
	}, []arrow.UnionTypeCode{0})
	dt2 := arrow.StructOf(arrow.Field{Name: "a", Type: dt1})

	pool := memory.DefaultAllocator
	bldr := array.NewStructBuilder(pool, dt2)
	defer bldr.Release()

	bldrDt1 := bldr.FieldBuilder(0).(*array.SparseUnionBuilder)
	binDictBldr := bldrDt1.Child(0).(*array.BinaryDictionaryBuilder)

	bldr.Append(true)
	bldrDt1.Append(0)
	binDictBldr.AppendString("foo")

	bldr.Append(true)
	bldrDt1.Append(0)
	binDictBldr.AppendString("bar")

	out := bldr.NewArray().(*array.Struct)
	defer out.Release()

	fmt.Println(out)

}
Output:

{[{c=foo} {c=bar}]}

func NewEmptySparseUnionBuilder

func NewEmptySparseUnionBuilder(mem memory.Allocator) *SparseUnionBuilder

NewEmptySparseUnionBuilder is a helper to construct a SparseUnionBuilder without having to predefine the union types. It creates a builder with no children and AppendChild will have to be called before appending any elements to this builder.

func NewSparseUnionBuilder

func NewSparseUnionBuilder(mem memory.Allocator, typ *arrow.SparseUnionType) *SparseUnionBuilder

NewSparseUnionBuilder constructs a new SparseUnionBuilder with the provided children and type codes. Builders will be constructed for each child using the fields in typ

func NewSparseUnionBuilderWithBuilders

func NewSparseUnionBuilderWithBuilders(mem memory.Allocator, typ *arrow.SparseUnionType, children []Builder) *SparseUnionBuilder

NewSparseUnionWithBuilders returns a new SparseUnionBuilder using the provided type and builders.

func (*SparseUnionBuilder) Append

func (b *SparseUnionBuilder) Append(nextType arrow.UnionTypeCode)

Append appends an element to the UnionArray and must be followed up by an append to the appropriate child builder. The parameter should be the type id of the child to which the next value will be appended.

After appending to the corresponding child builder, all other child builders should have a null or empty value appended to them (although this is not enforced and any value is theoretically allowed and will be ignored).

func (*SparseUnionBuilder) AppendChild

func (b *SparseUnionBuilder) AppendChild(newChild Builder, fieldName string) arrow.UnionTypeCode

func (*SparseUnionBuilder) AppendEmptyValue

func (b *SparseUnionBuilder) AppendEmptyValue()

AppendEmptyValue appends an empty value (implementation defined) to each child, and appends the type of the first typecode to the typeid buffer.

func (*SparseUnionBuilder) AppendEmptyValues

func (b *SparseUnionBuilder) AppendEmptyValues(n int)

AppendEmptyValues is identical to calling AppendEmptyValue() n times, except it pre-allocates first so it is more efficient.

func (*SparseUnionBuilder) AppendNull

func (b *SparseUnionBuilder) AppendNull()

AppendNull will append a null to the first child and an empty value (implementation-defined) to the rest of the children.

func (*SparseUnionBuilder) AppendNulls

func (b *SparseUnionBuilder) AppendNulls(n int)

AppendNulls is identical to calling AppendNull() n times, except it will pre-allocate with reserve for all the nulls beforehand.

func (*SparseUnionBuilder) AppendValueFromString

func (b *SparseUnionBuilder) AppendValueFromString(s string) error

func (*SparseUnionBuilder) Child

func (b *SparseUnionBuilder) Child(idx int) Builder

func (*SparseUnionBuilder) Len

func (b *SparseUnionBuilder) Len() int

Len returns the current number of elements in the builder.

func (*SparseUnionBuilder) Mode

func (b *SparseUnionBuilder) Mode() arrow.UnionMode

func (*SparseUnionBuilder) NewArray

func (b *SparseUnionBuilder) NewArray() arrow.Array

func (*SparseUnionBuilder) NewSparseUnionArray

func (b *SparseUnionBuilder) NewSparseUnionArray() (a *SparseUnion)

func (*SparseUnionBuilder) NumChildren

func (b *SparseUnionBuilder) NumChildren() int

func (*SparseUnionBuilder) Release

func (b *SparseUnionBuilder) Release()

func (*SparseUnionBuilder) Reserve

func (b *SparseUnionBuilder) Reserve(n int)

func (*SparseUnionBuilder) Resize

func (b *SparseUnionBuilder) Resize(n int)

func (*SparseUnionBuilder) Type

func (b *SparseUnionBuilder) Type() arrow.DataType

func (*SparseUnionBuilder) Unmarshal

func (b *SparseUnionBuilder) Unmarshal(dec *json.Decoder) error

func (*SparseUnionBuilder) UnmarshalJSON

func (b *SparseUnionBuilder) UnmarshalJSON(data []byte) (err error)

func (*SparseUnionBuilder) UnmarshalOne

func (b *SparseUnionBuilder) UnmarshalOne(dec *json.Decoder) error

type String

type String struct {
	// contains filtered or unexported fields
}

String represents an immutable sequence of variable-length UTF-8 strings.

func NewStringData

func NewStringData(data arrow.ArrayData) *String

NewStringData constructs a new String array from data.

func (*String) Data

func (a *String) Data() arrow.ArrayData

func (*String) DataType

func (a *String) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*String) GetOneForMarshal

func (a *String) GetOneForMarshal(i int) interface{}

func (*String) IsNull

func (a *String) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*String) IsValid

func (a *String) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*String) Len

func (a *String) Len() int

Len returns the number of elements in the array.

func (*String) MarshalJSON

func (a *String) MarshalJSON() ([]byte, error)

func (*String) NullBitmapBytes

func (a *String) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*String) NullN

func (a *String) NullN() int

NullN returns the number of null values in the array.

func (*String) Offset

func (a *String) Offset() int

func (*String) Release

func (a *String) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*String) Reset

func (a *String) Reset(data arrow.ArrayData)

Reset resets the String with a different set of Data.

func (*String) Retain

func (a *String) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*String) String

func (a *String) String() string

func (*String) Value

func (a *String) Value(i int) string

Value returns the slice at index i. This value should not be mutated.

func (*String) ValueBytes

func (a *String) ValueBytes() []byte

func (*String) ValueLen

func (a *String) ValueLen(i int) int

func (*String) ValueOffset

func (a *String) ValueOffset(i int) int

ValueOffset returns the offset of the value at index i.

func (*String) ValueOffset64

func (a *String) ValueOffset64(i int) int64

func (*String) ValueOffsets

func (a *String) ValueOffsets() []int32

func (*String) ValueStr

func (a *String) ValueStr(i int) string

type StringBuilder

type StringBuilder struct {
	*BinaryBuilder
}

A StringBuilder is used to build a String array using the Append methods.

func NewStringBuilder

func NewStringBuilder(mem memory.Allocator) *StringBuilder

NewStringBuilder creates a new StringBuilder.

func (*StringBuilder) Append

func (b *StringBuilder) Append(v string)

Append appends a string to the builder.

func (*StringBuilder) AppendValues

func (b *StringBuilder) AppendValues(v []string, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (StringBuilder) Cap

func (b StringBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (StringBuilder) IsNull

func (b StringBuilder) IsNull(i int) bool

func (StringBuilder) Len

func (b StringBuilder) Len() int

Len returns the number of elements in the array builder.

func (*StringBuilder) NewArray

func (b *StringBuilder) NewArray() arrow.Array

NewArray creates a String array from the memory buffers used by the builder and resets the StringBuilder so it can be used to build a new array.

func (*StringBuilder) NewStringArray

func (b *StringBuilder) NewStringArray() (a *String)

NewStringArray creates a String array from the memory buffers used by the builder and resets the StringBuilder so it can be used to build a new array.

func (StringBuilder) NullN

func (b StringBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (StringBuilder) Retain

func (b StringBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (StringBuilder) SetNull

func (b StringBuilder) SetNull(i int)

func (*StringBuilder) Type

func (b *StringBuilder) Type() arrow.DataType

func (*StringBuilder) Unmarshal

func (b *StringBuilder) Unmarshal(dec *json.Decoder) error

func (*StringBuilder) UnmarshalJSON

func (b *StringBuilder) UnmarshalJSON(data []byte) error

func (*StringBuilder) UnmarshalOne

func (b *StringBuilder) UnmarshalOne(dec *json.Decoder) error

func (StringBuilder) UnsafeAppendBoolToBitmap

func (b StringBuilder) UnsafeAppendBoolToBitmap(isValid bool)

func (*StringBuilder) Value

func (b *StringBuilder) Value(i int) string

Value returns the string at index i.

type StringLike

type StringLike interface {
	arrow.Array
	Value(int) string
	ValueLen(int) int
}

type StringLikeBuilder

type StringLikeBuilder interface {
	Builder
	Append(string)
	AppendValues([]string, []bool)
	UnsafeAppend([]byte)
	ReserveData(int)
}

type StringView

type StringView struct {
	// contains filtered or unexported fields
}

func NewStringViewData

func NewStringViewData(data arrow.ArrayData) *StringView

func (*StringView) Data

func (a *StringView) Data() arrow.ArrayData

func (*StringView) DataType

func (a *StringView) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*StringView) GetOneForMarshal

func (a *StringView) GetOneForMarshal(i int) interface{}

func (*StringView) IsNull

func (a *StringView) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*StringView) IsValid

func (a *StringView) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*StringView) Len

func (a *StringView) Len() int

Len returns the number of elements in the array.

func (*StringView) MarshalJSON

func (a *StringView) MarshalJSON() ([]byte, error)

func (*StringView) NullBitmapBytes

func (a *StringView) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*StringView) NullN

func (a *StringView) NullN() int

NullN returns the number of null values in the array.

func (*StringView) Offset

func (a *StringView) Offset() int

func (*StringView) Release

func (a *StringView) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*StringView) Reset

func (a *StringView) Reset(data arrow.ArrayData)

Reset resets the String with a different set of Data.

func (*StringView) Retain

func (a *StringView) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*StringView) String

func (a *StringView) String() string

func (*StringView) Value

func (a *StringView) Value(i int) string

func (*StringView) ValueHeader

func (a *StringView) ValueHeader(i int) *arrow.ViewHeader

func (*StringView) ValueLen

func (a *StringView) ValueLen(i int) int

func (*StringView) ValueStr

func (a *StringView) ValueStr(i int) string

type StringViewBuilder

type StringViewBuilder struct {
	*BinaryViewBuilder
}

func NewStringViewBuilder

func NewStringViewBuilder(mem memory.Allocator) *StringViewBuilder

func (*StringViewBuilder) Append

func (b *StringViewBuilder) Append(v string)

func (*StringViewBuilder) AppendValues

func (b *StringViewBuilder) AppendValues(v []string, valid []bool)

func (StringViewBuilder) Cap

func (b StringViewBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (StringViewBuilder) IsNull

func (b StringViewBuilder) IsNull(i int) bool

func (StringViewBuilder) Len

func (b StringViewBuilder) Len() int

Len returns the number of elements in the array builder.

func (*StringViewBuilder) NewArray

func (b *StringViewBuilder) NewArray() arrow.Array

func (*StringViewBuilder) NewStringViewArray

func (b *StringViewBuilder) NewStringViewArray() (a *StringView)

func (StringViewBuilder) NullN

func (b StringViewBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (StringViewBuilder) Retain

func (b StringViewBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (StringViewBuilder) SetNull

func (b StringViewBuilder) SetNull(i int)

func (*StringViewBuilder) Unmarshal

func (b *StringViewBuilder) Unmarshal(dec *json.Decoder) error

func (*StringViewBuilder) UnmarshalJSON

func (b *StringViewBuilder) UnmarshalJSON(data []byte) error

func (*StringViewBuilder) UnmarshalOne

func (b *StringViewBuilder) UnmarshalOne(dec *json.Decoder) error

func (StringViewBuilder) UnsafeAppendBoolToBitmap

func (b StringViewBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type Struct

type Struct struct {
	// contains filtered or unexported fields
}

Struct represents an ordered sequence of relative types.

func NewStructArray

func NewStructArray(cols []arrow.Array, names []string) (*Struct, error)

NewStructArray constructs a new Struct Array out of the columns passed in and the field names. The length of all cols must be the same and there should be the same number of columns as names.

func NewStructArrayWithNulls

func NewStructArrayWithNulls(cols []arrow.Array, names []string, nullBitmap *memory.Buffer, nullCount int, offset int) (*Struct, error)

NewStructArrayWithNulls is like NewStructArray as a convenience function, but also takes in a null bitmap, the number of nulls, and an optional offset to use for creating the Struct Array.

func NewStructData

func NewStructData(data arrow.ArrayData) *Struct

NewStructData returns a new Struct array value from data.

func RecordToStructArray

func RecordToStructArray(rec arrow.Record) *Struct

RecordToStructArray constructs a struct array from the columns of the record batch by referencing them, zero-copy.

func (*Struct) Data

func (a *Struct) Data() arrow.ArrayData

func (*Struct) DataType

func (a *Struct) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Struct) Field

func (a *Struct) Field(i int) arrow.Array

func (*Struct) GetOneForMarshal

func (a *Struct) GetOneForMarshal(i int) interface{}

func (*Struct) IsNull

func (a *Struct) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Struct) IsValid

func (a *Struct) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Struct) Len

func (a *Struct) Len() int

Len returns the number of elements in the array.

func (*Struct) MarshalJSON

func (a *Struct) MarshalJSON() ([]byte, error)

func (*Struct) NullBitmapBytes

func (a *Struct) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Struct) NullN

func (a *Struct) NullN() int

NullN returns the number of null values in the array.

func (*Struct) NumField

func (a *Struct) NumField() int

func (*Struct) Offset

func (a *Struct) Offset() int

func (*Struct) Release

func (a *Struct) Release()

func (*Struct) Retain

func (a *Struct) Retain()

func (*Struct) String

func (a *Struct) String() string

func (*Struct) ValueStr

func (a *Struct) ValueStr(i int) string

ValueStr returns the string representation (as json) of the value at index i.

type StructBuilder

type StructBuilder struct {
	// contains filtered or unexported fields
}

func NewStructBuilder

func NewStructBuilder(mem memory.Allocator, dtype *arrow.StructType) *StructBuilder

NewStructBuilder returns a builder, using the provided memory allocator.

func (*StructBuilder) Append

func (b *StructBuilder) Append(v bool)

func (*StructBuilder) AppendEmptyValue

func (b *StructBuilder) AppendEmptyValue()

func (*StructBuilder) AppendEmptyValues

func (b *StructBuilder) AppendEmptyValues(n int)

func (*StructBuilder) AppendNull

func (b *StructBuilder) AppendNull()

func (*StructBuilder) AppendNulls

func (b *StructBuilder) AppendNulls(n int)

func (*StructBuilder) AppendValueFromString

func (b *StructBuilder) AppendValueFromString(s string) error

func (*StructBuilder) AppendValues

func (b *StructBuilder) AppendValues(valids []bool)

func (*StructBuilder) Cap

func (b *StructBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*StructBuilder) FieldBuilder

func (b *StructBuilder) FieldBuilder(i int) Builder

func (*StructBuilder) IsNull

func (b *StructBuilder) IsNull(i int) bool

func (*StructBuilder) Len

func (b *StructBuilder) Len() int

Len returns the number of elements in the array builder.

func (*StructBuilder) NewArray

func (b *StructBuilder) NewArray() arrow.Array

NewArray creates a Struct array from the memory buffers used by the builder and resets the StructBuilder so it can be used to build a new array.

func (*StructBuilder) NewStructArray

func (b *StructBuilder) NewStructArray() (a *Struct)

NewStructArray creates a Struct array from the memory buffers used by the builder and resets the StructBuilder so it can be used to build a new array.

func (*StructBuilder) NullN

func (b *StructBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*StructBuilder) NumField

func (b *StructBuilder) NumField() int

func (*StructBuilder) Release

func (b *StructBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*StructBuilder) Reserve

func (b *StructBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*StructBuilder) Resize

func (b *StructBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*StructBuilder) Retain

func (b *StructBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*StructBuilder) SetNull

func (b *StructBuilder) SetNull(i int)

func (*StructBuilder) Type

func (b *StructBuilder) Type() arrow.DataType

func (*StructBuilder) Unmarshal

func (b *StructBuilder) Unmarshal(dec *json.Decoder) error

func (*StructBuilder) UnmarshalJSON

func (b *StructBuilder) UnmarshalJSON(data []byte) error

func (*StructBuilder) UnmarshalOne

func (b *StructBuilder) UnmarshalOne(dec *json.Decoder) error

func (*StructBuilder) UnsafeAppendBoolToBitmap

func (b *StructBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type TableReader

type TableReader struct {
	// contains filtered or unexported fields
}

TableReader is a Record iterator over a (possibly chunked) Table

func NewTableReader

func NewTableReader(tbl arrow.Table, chunkSize int64) *TableReader

NewTableReader returns a new TableReader to iterate over the (possibly chunked) Table. if chunkSize is <= 0, the biggest possible chunk will be selected.

func (*TableReader) Err

func (tr *TableReader) Err() error

func (*TableReader) Next

func (tr *TableReader) Next() bool

func (*TableReader) Record

func (tr *TableReader) Record() arrow.Record

func (*TableReader) Release

func (tr *TableReader) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed. Release may be called simultaneously from multiple goroutines.

func (*TableReader) Retain

func (tr *TableReader) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*TableReader) Schema

func (tr *TableReader) Schema() *arrow.Schema

type Time32

type Time32 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of arrow.Time32 values.

func NewTime32Data

func NewTime32Data(data arrow.ArrayData) *Time32

NewTime32Data creates a new Time32.

func (*Time32) Data

func (a *Time32) Data() arrow.ArrayData

func (*Time32) DataType

func (a *Time32) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Time32) GetOneForMarshal

func (a *Time32) GetOneForMarshal(i int) interface{}

func (*Time32) IsNull

func (a *Time32) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Time32) IsValid

func (a *Time32) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Time32) Len

func (a *Time32) Len() int

Len returns the number of elements in the array.

func (*Time32) MarshalJSON

func (a *Time32) MarshalJSON() ([]byte, error)

func (*Time32) NullBitmapBytes

func (a *Time32) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Time32) NullN

func (a *Time32) NullN() int

NullN returns the number of null values in the array.

func (*Time32) Offset

func (a *Time32) Offset() int

func (*Time32) Release

func (a *Time32) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Time32) Reset

func (a *Time32) Reset(data *Data)

Reset resets the array for re-use.

func (*Time32) Retain

func (a *Time32) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Time32) String

func (a *Time32) String() string

String returns a string representation of the array.

func (*Time32) Time32Values

func (a *Time32) Time32Values() []arrow.Time32

Values returns the values.

func (*Time32) Value

func (a *Time32) Value(i int) arrow.Time32

Value returns the value at the specified index.

func (*Time32) ValueStr

func (a *Time32) ValueStr(i int) string

type Time32Builder

type Time32Builder struct {
	// contains filtered or unexported fields
}

func NewTime32Builder

func NewTime32Builder(mem memory.Allocator, dtype *arrow.Time32Type) *Time32Builder

func (*Time32Builder) Append

func (b *Time32Builder) Append(v arrow.Time32)

func (*Time32Builder) AppendEmptyValue

func (b *Time32Builder) AppendEmptyValue()

func (*Time32Builder) AppendEmptyValues

func (b *Time32Builder) AppendEmptyValues(n int)

func (*Time32Builder) AppendNull

func (b *Time32Builder) AppendNull()

func (*Time32Builder) AppendNulls

func (b *Time32Builder) AppendNulls(n int)

func (*Time32Builder) AppendValueFromString

func (b *Time32Builder) AppendValueFromString(s string) error

func (*Time32Builder) AppendValues

func (b *Time32Builder) AppendValues(v []arrow.Time32, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Time32Builder) Cap

func (b *Time32Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Time32Builder) IsNull

func (b *Time32Builder) IsNull(i int) bool

func (*Time32Builder) Len

func (b *Time32Builder) Len() int

Len returns the number of elements in the array builder.

func (*Time32Builder) NewArray

func (b *Time32Builder) NewArray() arrow.Array

NewArray creates a Time32 array from the memory buffers used by the builder and resets the Time32Builder so it can be used to build a new array.

func (*Time32Builder) NewTime32Array

func (b *Time32Builder) NewTime32Array() (a *Time32)

NewTime32Array creates a Time32 array from the memory buffers used by the builder and resets the Time32Builder so it can be used to build a new array.

func (*Time32Builder) NullN

func (b *Time32Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Time32Builder) Release

func (b *Time32Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Time32Builder) Reserve

func (b *Time32Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Time32Builder) Resize

func (b *Time32Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Time32Builder) Retain

func (b *Time32Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Time32Builder) SetNull

func (b *Time32Builder) SetNull(i int)

func (*Time32Builder) Type

func (b *Time32Builder) Type() arrow.DataType

func (*Time32Builder) Unmarshal

func (b *Time32Builder) Unmarshal(dec *json.Decoder) error

func (*Time32Builder) UnmarshalJSON

func (b *Time32Builder) UnmarshalJSON(data []byte) error

func (*Time32Builder) UnmarshalOne

func (b *Time32Builder) UnmarshalOne(dec *json.Decoder) error

func (*Time32Builder) UnsafeAppend

func (b *Time32Builder) UnsafeAppend(v arrow.Time32)

func (*Time32Builder) UnsafeAppendBoolToBitmap

func (b *Time32Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Time32Builder) Value

func (b *Time32Builder) Value(i int) arrow.Time32

type Time32DictionaryBuilder

type Time32DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Time32DictionaryBuilder) Append

func (*Time32DictionaryBuilder) AppendArray

func (b *Time32DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Time32DictionaryBuilder) AppendEmptyValue

func (b *Time32DictionaryBuilder) AppendEmptyValue()

func (*Time32DictionaryBuilder) AppendEmptyValues

func (b *Time32DictionaryBuilder) AppendEmptyValues(n int)

func (*Time32DictionaryBuilder) AppendIndices

func (b *Time32DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Time32DictionaryBuilder) AppendNull

func (b *Time32DictionaryBuilder) AppendNull()

func (*Time32DictionaryBuilder) AppendNulls

func (b *Time32DictionaryBuilder) AppendNulls(n int)

func (*Time32DictionaryBuilder) AppendValueFromString

func (b *Time32DictionaryBuilder) AppendValueFromString(s string) error

func (*Time32DictionaryBuilder) Cap

func (b *Time32DictionaryBuilder) Cap() int

func (*Time32DictionaryBuilder) DictionarySize

func (b *Time32DictionaryBuilder) DictionarySize() int

func (*Time32DictionaryBuilder) IndexBuilder

func (b *Time32DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Time32DictionaryBuilder) InsertDictValues

func (b *Time32DictionaryBuilder) InsertDictValues(arr *Time32) (err error)

func (*Time32DictionaryBuilder) IsNull

func (b *Time32DictionaryBuilder) IsNull(i int) bool

func (*Time32DictionaryBuilder) NewArray

func (b *Time32DictionaryBuilder) NewArray() arrow.Array

func (*Time32DictionaryBuilder) NewDelta

func (b *Time32DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Time32DictionaryBuilder) NewDictionaryArray

func (b *Time32DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Time32DictionaryBuilder) Release

func (b *Time32DictionaryBuilder) Release()

func (*Time32DictionaryBuilder) Reserve

func (b *Time32DictionaryBuilder) Reserve(n int)

func (*Time32DictionaryBuilder) ResetFull

func (b *Time32DictionaryBuilder) ResetFull()

func (*Time32DictionaryBuilder) Resize

func (b *Time32DictionaryBuilder) Resize(n int)

func (*Time32DictionaryBuilder) Type

func (b *Time32DictionaryBuilder) Type() arrow.DataType

func (*Time32DictionaryBuilder) Unmarshal

func (b *Time32DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Time32DictionaryBuilder) UnmarshalJSON

func (b *Time32DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Time32DictionaryBuilder) UnmarshalOne

func (b *Time32DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Time64

type Time64 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of arrow.Time64 values.

func NewTime64Data

func NewTime64Data(data arrow.ArrayData) *Time64

NewTime64Data creates a new Time64.

func (*Time64) Data

func (a *Time64) Data() arrow.ArrayData

func (*Time64) DataType

func (a *Time64) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Time64) GetOneForMarshal

func (a *Time64) GetOneForMarshal(i int) interface{}

func (*Time64) IsNull

func (a *Time64) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Time64) IsValid

func (a *Time64) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Time64) Len

func (a *Time64) Len() int

Len returns the number of elements in the array.

func (*Time64) MarshalJSON

func (a *Time64) MarshalJSON() ([]byte, error)

func (*Time64) NullBitmapBytes

func (a *Time64) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Time64) NullN

func (a *Time64) NullN() int

NullN returns the number of null values in the array.

func (*Time64) Offset

func (a *Time64) Offset() int

func (*Time64) Release

func (a *Time64) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Time64) Reset

func (a *Time64) Reset(data *Data)

Reset resets the array for re-use.

func (*Time64) Retain

func (a *Time64) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Time64) String

func (a *Time64) String() string

String returns a string representation of the array.

func (*Time64) Time64Values

func (a *Time64) Time64Values() []arrow.Time64

Values returns the values.

func (*Time64) Value

func (a *Time64) Value(i int) arrow.Time64

Value returns the value at the specified index.

func (*Time64) ValueStr

func (a *Time64) ValueStr(i int) string

type Time64Builder

type Time64Builder struct {
	// contains filtered or unexported fields
}

func NewTime64Builder

func NewTime64Builder(mem memory.Allocator, dtype *arrow.Time64Type) *Time64Builder

func (*Time64Builder) Append

func (b *Time64Builder) Append(v arrow.Time64)

func (*Time64Builder) AppendEmptyValue

func (b *Time64Builder) AppendEmptyValue()

func (*Time64Builder) AppendEmptyValues

func (b *Time64Builder) AppendEmptyValues(n int)

func (*Time64Builder) AppendNull

func (b *Time64Builder) AppendNull()

func (*Time64Builder) AppendNulls

func (b *Time64Builder) AppendNulls(n int)

func (*Time64Builder) AppendValueFromString

func (b *Time64Builder) AppendValueFromString(s string) error

func (*Time64Builder) AppendValues

func (b *Time64Builder) AppendValues(v []arrow.Time64, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Time64Builder) Cap

func (b *Time64Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Time64Builder) IsNull

func (b *Time64Builder) IsNull(i int) bool

func (*Time64Builder) Len

func (b *Time64Builder) Len() int

Len returns the number of elements in the array builder.

func (*Time64Builder) NewArray

func (b *Time64Builder) NewArray() arrow.Array

NewArray creates a Time64 array from the memory buffers used by the builder and resets the Time64Builder so it can be used to build a new array.

func (*Time64Builder) NewTime64Array

func (b *Time64Builder) NewTime64Array() (a *Time64)

NewTime64Array creates a Time64 array from the memory buffers used by the builder and resets the Time64Builder so it can be used to build a new array.

func (*Time64Builder) NullN

func (b *Time64Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Time64Builder) Release

func (b *Time64Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Time64Builder) Reserve

func (b *Time64Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Time64Builder) Resize

func (b *Time64Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Time64Builder) Retain

func (b *Time64Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Time64Builder) SetNull

func (b *Time64Builder) SetNull(i int)

func (*Time64Builder) Type

func (b *Time64Builder) Type() arrow.DataType

func (*Time64Builder) Unmarshal

func (b *Time64Builder) Unmarshal(dec *json.Decoder) error

func (*Time64Builder) UnmarshalJSON

func (b *Time64Builder) UnmarshalJSON(data []byte) error

func (*Time64Builder) UnmarshalOne

func (b *Time64Builder) UnmarshalOne(dec *json.Decoder) error

func (*Time64Builder) UnsafeAppend

func (b *Time64Builder) UnsafeAppend(v arrow.Time64)

func (*Time64Builder) UnsafeAppendBoolToBitmap

func (b *Time64Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Time64Builder) Value

func (b *Time64Builder) Value(i int) arrow.Time64

type Time64DictionaryBuilder

type Time64DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Time64DictionaryBuilder) Append

func (*Time64DictionaryBuilder) AppendArray

func (b *Time64DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Time64DictionaryBuilder) AppendEmptyValue

func (b *Time64DictionaryBuilder) AppendEmptyValue()

func (*Time64DictionaryBuilder) AppendEmptyValues

func (b *Time64DictionaryBuilder) AppendEmptyValues(n int)

func (*Time64DictionaryBuilder) AppendIndices

func (b *Time64DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Time64DictionaryBuilder) AppendNull

func (b *Time64DictionaryBuilder) AppendNull()

func (*Time64DictionaryBuilder) AppendNulls

func (b *Time64DictionaryBuilder) AppendNulls(n int)

func (*Time64DictionaryBuilder) AppendValueFromString

func (b *Time64DictionaryBuilder) AppendValueFromString(s string) error

func (*Time64DictionaryBuilder) Cap

func (b *Time64DictionaryBuilder) Cap() int

func (*Time64DictionaryBuilder) DictionarySize

func (b *Time64DictionaryBuilder) DictionarySize() int

func (*Time64DictionaryBuilder) IndexBuilder

func (b *Time64DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Time64DictionaryBuilder) InsertDictValues

func (b *Time64DictionaryBuilder) InsertDictValues(arr *Time64) (err error)

func (*Time64DictionaryBuilder) IsNull

func (b *Time64DictionaryBuilder) IsNull(i int) bool

func (*Time64DictionaryBuilder) NewArray

func (b *Time64DictionaryBuilder) NewArray() arrow.Array

func (*Time64DictionaryBuilder) NewDelta

func (b *Time64DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Time64DictionaryBuilder) NewDictionaryArray

func (b *Time64DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Time64DictionaryBuilder) Release

func (b *Time64DictionaryBuilder) Release()

func (*Time64DictionaryBuilder) Reserve

func (b *Time64DictionaryBuilder) Reserve(n int)

func (*Time64DictionaryBuilder) ResetFull

func (b *Time64DictionaryBuilder) ResetFull()

func (*Time64DictionaryBuilder) Resize

func (b *Time64DictionaryBuilder) Resize(n int)

func (*Time64DictionaryBuilder) Type

func (b *Time64DictionaryBuilder) Type() arrow.DataType

func (*Time64DictionaryBuilder) Unmarshal

func (b *Time64DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Time64DictionaryBuilder) UnmarshalJSON

func (b *Time64DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Time64DictionaryBuilder) UnmarshalOne

func (b *Time64DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Timestamp

type Timestamp struct {
	// contains filtered or unexported fields
}

Timestamp represents an immutable sequence of arrow.Timestamp values.

func NewTimestampData

func NewTimestampData(data arrow.ArrayData) *Timestamp

NewTimestampData creates a new Timestamp from Data.

func (*Timestamp) Data

func (a *Timestamp) Data() arrow.ArrayData

func (*Timestamp) DataType

func (a *Timestamp) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Timestamp) GetOneForMarshal

func (a *Timestamp) GetOneForMarshal(i int) interface{}

func (*Timestamp) IsNull

func (a *Timestamp) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Timestamp) IsValid

func (a *Timestamp) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Timestamp) Len

func (a *Timestamp) Len() int

Len returns the number of elements in the array.

func (*Timestamp) MarshalJSON

func (a *Timestamp) MarshalJSON() ([]byte, error)

func (*Timestamp) NullBitmapBytes

func (a *Timestamp) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Timestamp) NullN

func (a *Timestamp) NullN() int

NullN returns the number of null values in the array.

func (*Timestamp) Offset

func (a *Timestamp) Offset() int

func (*Timestamp) Release

func (a *Timestamp) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Timestamp) Reset

func (a *Timestamp) Reset(data *Data)

Reset resets the array for re-use.

func (*Timestamp) Retain

func (a *Timestamp) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Timestamp) String

func (a *Timestamp) String() string

String returns a string representation of the array.

func (*Timestamp) TimestampValues

func (a *Timestamp) TimestampValues() []arrow.Timestamp

TimestampValues returns the values.

func (*Timestamp) Value

func (a *Timestamp) Value(i int) arrow.Timestamp

Value returns the value at the specified index.

func (*Timestamp) ValueStr

func (a *Timestamp) ValueStr(i int) string

type TimestampBuilder

type TimestampBuilder struct {
	// contains filtered or unexported fields
}

func NewTimestampBuilder

func NewTimestampBuilder(mem memory.Allocator, dtype *arrow.TimestampType) *TimestampBuilder

func (*TimestampBuilder) Append

func (b *TimestampBuilder) Append(v arrow.Timestamp)

func (*TimestampBuilder) AppendEmptyValue

func (b *TimestampBuilder) AppendEmptyValue()

func (*TimestampBuilder) AppendEmptyValues

func (b *TimestampBuilder) AppendEmptyValues(n int)

func (*TimestampBuilder) AppendNull

func (b *TimestampBuilder) AppendNull()

func (*TimestampBuilder) AppendNulls

func (b *TimestampBuilder) AppendNulls(n int)

func (*TimestampBuilder) AppendTime

func (b *TimestampBuilder) AppendTime(t time.Time)

func (*TimestampBuilder) AppendValueFromString

func (b *TimestampBuilder) AppendValueFromString(s string) error

func (*TimestampBuilder) AppendValues

func (b *TimestampBuilder) AppendValues(v []arrow.Timestamp, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*TimestampBuilder) Cap

func (b *TimestampBuilder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*TimestampBuilder) IsNull

func (b *TimestampBuilder) IsNull(i int) bool

func (*TimestampBuilder) Len

func (b *TimestampBuilder) Len() int

Len returns the number of elements in the array builder.

func (*TimestampBuilder) NewArray

func (b *TimestampBuilder) NewArray() arrow.Array

NewArray creates a Timestamp array from the memory buffers used by the builder and resets the TimestampBuilder so it can be used to build a new array.

func (*TimestampBuilder) NewTimestampArray

func (b *TimestampBuilder) NewTimestampArray() (a *Timestamp)

NewTimestampArray creates a Timestamp array from the memory buffers used by the builder and resets the TimestampBuilder so it can be used to build a new array.

func (*TimestampBuilder) NullN

func (b *TimestampBuilder) NullN() int

NullN returns the number of null values in the array builder.

func (*TimestampBuilder) Release

func (b *TimestampBuilder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*TimestampBuilder) Reserve

func (b *TimestampBuilder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*TimestampBuilder) Resize

func (b *TimestampBuilder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*TimestampBuilder) Retain

func (b *TimestampBuilder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*TimestampBuilder) SetNull

func (b *TimestampBuilder) SetNull(i int)

func (*TimestampBuilder) Type

func (b *TimestampBuilder) Type() arrow.DataType

func (*TimestampBuilder) Unmarshal

func (b *TimestampBuilder) Unmarshal(dec *json.Decoder) error

func (*TimestampBuilder) UnmarshalJSON

func (b *TimestampBuilder) UnmarshalJSON(data []byte) error

func (*TimestampBuilder) UnmarshalOne

func (b *TimestampBuilder) UnmarshalOne(dec *json.Decoder) error

func (*TimestampBuilder) UnsafeAppend

func (b *TimestampBuilder) UnsafeAppend(v arrow.Timestamp)

func (*TimestampBuilder) UnsafeAppendBoolToBitmap

func (b *TimestampBuilder) UnsafeAppendBoolToBitmap(isValid bool)

type TimestampDictionaryBuilder

type TimestampDictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*TimestampDictionaryBuilder) Append

func (*TimestampDictionaryBuilder) AppendArray

func (b *TimestampDictionaryBuilder) AppendArray(arr arrow.Array) error

func (*TimestampDictionaryBuilder) AppendEmptyValue

func (b *TimestampDictionaryBuilder) AppendEmptyValue()

func (*TimestampDictionaryBuilder) AppendEmptyValues

func (b *TimestampDictionaryBuilder) AppendEmptyValues(n int)

func (*TimestampDictionaryBuilder) AppendIndices

func (b *TimestampDictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*TimestampDictionaryBuilder) AppendNull

func (b *TimestampDictionaryBuilder) AppendNull()

func (*TimestampDictionaryBuilder) AppendNulls

func (b *TimestampDictionaryBuilder) AppendNulls(n int)

func (*TimestampDictionaryBuilder) AppendValueFromString

func (b *TimestampDictionaryBuilder) AppendValueFromString(s string) error

func (*TimestampDictionaryBuilder) Cap

func (b *TimestampDictionaryBuilder) Cap() int

func (*TimestampDictionaryBuilder) DictionarySize

func (b *TimestampDictionaryBuilder) DictionarySize() int

func (*TimestampDictionaryBuilder) IndexBuilder

func (b *TimestampDictionaryBuilder) IndexBuilder() IndexBuilder

func (*TimestampDictionaryBuilder) InsertDictValues

func (b *TimestampDictionaryBuilder) InsertDictValues(arr *Timestamp) (err error)

func (*TimestampDictionaryBuilder) IsNull

func (b *TimestampDictionaryBuilder) IsNull(i int) bool

func (*TimestampDictionaryBuilder) NewArray

func (b *TimestampDictionaryBuilder) NewArray() arrow.Array

func (*TimestampDictionaryBuilder) NewDelta

func (b *TimestampDictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*TimestampDictionaryBuilder) NewDictionaryArray

func (b *TimestampDictionaryBuilder) NewDictionaryArray() *Dictionary

func (*TimestampDictionaryBuilder) Release

func (b *TimestampDictionaryBuilder) Release()

func (*TimestampDictionaryBuilder) Reserve

func (b *TimestampDictionaryBuilder) Reserve(n int)

func (*TimestampDictionaryBuilder) ResetFull

func (b *TimestampDictionaryBuilder) ResetFull()

func (*TimestampDictionaryBuilder) Resize

func (b *TimestampDictionaryBuilder) Resize(n int)

func (*TimestampDictionaryBuilder) Type

func (b *TimestampDictionaryBuilder) Type() arrow.DataType

func (*TimestampDictionaryBuilder) Unmarshal

func (b *TimestampDictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*TimestampDictionaryBuilder) UnmarshalJSON

func (b *TimestampDictionaryBuilder) UnmarshalJSON(data []byte) error

func (*TimestampDictionaryBuilder) UnmarshalOne

func (b *TimestampDictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Uint16

type Uint16 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of uint16 values.

func NewUint16Data

func NewUint16Data(data arrow.ArrayData) *Uint16

NewUint16Data creates a new Uint16.

func (*Uint16) Data

func (a *Uint16) Data() arrow.ArrayData

func (*Uint16) DataType

func (a *Uint16) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Uint16) GetOneForMarshal

func (a *Uint16) GetOneForMarshal(i int) interface{}

func (*Uint16) IsNull

func (a *Uint16) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Uint16) IsValid

func (a *Uint16) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Uint16) Len

func (a *Uint16) Len() int

Len returns the number of elements in the array.

func (*Uint16) MarshalJSON

func (a *Uint16) MarshalJSON() ([]byte, error)

func (*Uint16) NullBitmapBytes

func (a *Uint16) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Uint16) NullN

func (a *Uint16) NullN() int

NullN returns the number of null values in the array.

func (*Uint16) Offset

func (a *Uint16) Offset() int

func (*Uint16) Release

func (a *Uint16) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Uint16) Reset

func (a *Uint16) Reset(data *Data)

Reset resets the array for re-use.

func (*Uint16) Retain

func (a *Uint16) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Uint16) String

func (a *Uint16) String() string

String returns a string representation of the array.

func (*Uint16) Uint16Values

func (a *Uint16) Uint16Values() []uint16

Values returns the values.

func (*Uint16) Value

func (a *Uint16) Value(i int) uint16

Value returns the value at the specified index.

func (*Uint16) ValueStr

func (a *Uint16) ValueStr(i int) string

type Uint16Builder

type Uint16Builder struct {
	// contains filtered or unexported fields
}

func NewUint16Builder

func NewUint16Builder(mem memory.Allocator) *Uint16Builder

func (*Uint16Builder) Append

func (b *Uint16Builder) Append(v uint16)

func (*Uint16Builder) AppendEmptyValue

func (b *Uint16Builder) AppendEmptyValue()

func (*Uint16Builder) AppendEmptyValues

func (b *Uint16Builder) AppendEmptyValues(n int)

func (*Uint16Builder) AppendNull

func (b *Uint16Builder) AppendNull()

func (*Uint16Builder) AppendNulls

func (b *Uint16Builder) AppendNulls(n int)

func (*Uint16Builder) AppendValueFromString

func (b *Uint16Builder) AppendValueFromString(s string) error

func (*Uint16Builder) AppendValues

func (b *Uint16Builder) AppendValues(v []uint16, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Uint16Builder) Cap

func (b *Uint16Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Uint16Builder) IsNull

func (b *Uint16Builder) IsNull(i int) bool

func (*Uint16Builder) Len

func (b *Uint16Builder) Len() int

Len returns the number of elements in the array builder.

func (*Uint16Builder) NewArray

func (b *Uint16Builder) NewArray() arrow.Array

NewArray creates a Uint16 array from the memory buffers used by the builder and resets the Uint16Builder so it can be used to build a new array.

func (*Uint16Builder) NewUint16Array

func (b *Uint16Builder) NewUint16Array() (a *Uint16)

NewUint16Array creates a Uint16 array from the memory buffers used by the builder and resets the Uint16Builder so it can be used to build a new array.

func (*Uint16Builder) NullN

func (b *Uint16Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Uint16Builder) Release

func (b *Uint16Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Uint16Builder) Reserve

func (b *Uint16Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Uint16Builder) Resize

func (b *Uint16Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Uint16Builder) Retain

func (b *Uint16Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Uint16Builder) SetNull

func (b *Uint16Builder) SetNull(i int)

func (*Uint16Builder) Type

func (b *Uint16Builder) Type() arrow.DataType

func (*Uint16Builder) Unmarshal

func (b *Uint16Builder) Unmarshal(dec *json.Decoder) error

func (*Uint16Builder) UnmarshalJSON

func (b *Uint16Builder) UnmarshalJSON(data []byte) error

func (*Uint16Builder) UnmarshalOne

func (b *Uint16Builder) UnmarshalOne(dec *json.Decoder) error

func (*Uint16Builder) UnsafeAppend

func (b *Uint16Builder) UnsafeAppend(v uint16)

func (*Uint16Builder) UnsafeAppendBoolToBitmap

func (b *Uint16Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Uint16Builder) Value

func (b *Uint16Builder) Value(i int) uint16

type Uint16DictionaryBuilder

type Uint16DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Uint16DictionaryBuilder) Append

func (b *Uint16DictionaryBuilder) Append(v uint16) error

func (*Uint16DictionaryBuilder) AppendArray

func (b *Uint16DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Uint16DictionaryBuilder) AppendEmptyValue

func (b *Uint16DictionaryBuilder) AppendEmptyValue()

func (*Uint16DictionaryBuilder) AppendEmptyValues

func (b *Uint16DictionaryBuilder) AppendEmptyValues(n int)

func (*Uint16DictionaryBuilder) AppendIndices

func (b *Uint16DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Uint16DictionaryBuilder) AppendNull

func (b *Uint16DictionaryBuilder) AppendNull()

func (*Uint16DictionaryBuilder) AppendNulls

func (b *Uint16DictionaryBuilder) AppendNulls(n int)

func (*Uint16DictionaryBuilder) AppendValueFromString

func (b *Uint16DictionaryBuilder) AppendValueFromString(s string) error

func (*Uint16DictionaryBuilder) Cap

func (b *Uint16DictionaryBuilder) Cap() int

func (*Uint16DictionaryBuilder) DictionarySize

func (b *Uint16DictionaryBuilder) DictionarySize() int

func (*Uint16DictionaryBuilder) IndexBuilder

func (b *Uint16DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Uint16DictionaryBuilder) InsertDictValues

func (b *Uint16DictionaryBuilder) InsertDictValues(arr *Uint16) (err error)

func (*Uint16DictionaryBuilder) IsNull

func (b *Uint16DictionaryBuilder) IsNull(i int) bool

func (*Uint16DictionaryBuilder) NewArray

func (b *Uint16DictionaryBuilder) NewArray() arrow.Array

func (*Uint16DictionaryBuilder) NewDelta

func (b *Uint16DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Uint16DictionaryBuilder) NewDictionaryArray

func (b *Uint16DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Uint16DictionaryBuilder) Release

func (b *Uint16DictionaryBuilder) Release()

func (*Uint16DictionaryBuilder) Reserve

func (b *Uint16DictionaryBuilder) Reserve(n int)

func (*Uint16DictionaryBuilder) ResetFull

func (b *Uint16DictionaryBuilder) ResetFull()

func (*Uint16DictionaryBuilder) Resize

func (b *Uint16DictionaryBuilder) Resize(n int)

func (*Uint16DictionaryBuilder) Type

func (b *Uint16DictionaryBuilder) Type() arrow.DataType

func (*Uint16DictionaryBuilder) Unmarshal

func (b *Uint16DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Uint16DictionaryBuilder) UnmarshalJSON

func (b *Uint16DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Uint16DictionaryBuilder) UnmarshalOne

func (b *Uint16DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Uint32

type Uint32 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of uint32 values.

func NewUint32Data

func NewUint32Data(data arrow.ArrayData) *Uint32

NewUint32Data creates a new Uint32.

func (*Uint32) Data

func (a *Uint32) Data() arrow.ArrayData

func (*Uint32) DataType

func (a *Uint32) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Uint32) GetOneForMarshal

func (a *Uint32) GetOneForMarshal(i int) interface{}

func (*Uint32) IsNull

func (a *Uint32) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Uint32) IsValid

func (a *Uint32) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Uint32) Len

func (a *Uint32) Len() int

Len returns the number of elements in the array.

func (*Uint32) MarshalJSON

func (a *Uint32) MarshalJSON() ([]byte, error)

func (*Uint32) NullBitmapBytes

func (a *Uint32) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Uint32) NullN

func (a *Uint32) NullN() int

NullN returns the number of null values in the array.

func (*Uint32) Offset

func (a *Uint32) Offset() int

func (*Uint32) Release

func (a *Uint32) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Uint32) Reset

func (a *Uint32) Reset(data *Data)

Reset resets the array for re-use.

func (*Uint32) Retain

func (a *Uint32) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Uint32) String

func (a *Uint32) String() string

String returns a string representation of the array.

func (*Uint32) Uint32Values

func (a *Uint32) Uint32Values() []uint32

Values returns the values.

func (*Uint32) Value

func (a *Uint32) Value(i int) uint32

Value returns the value at the specified index.

func (*Uint32) ValueStr

func (a *Uint32) ValueStr(i int) string

type Uint32Builder

type Uint32Builder struct {
	// contains filtered or unexported fields
}

func NewUint32Builder

func NewUint32Builder(mem memory.Allocator) *Uint32Builder

func (*Uint32Builder) Append

func (b *Uint32Builder) Append(v uint32)

func (*Uint32Builder) AppendEmptyValue

func (b *Uint32Builder) AppendEmptyValue()

func (*Uint32Builder) AppendEmptyValues

func (b *Uint32Builder) AppendEmptyValues(n int)

func (*Uint32Builder) AppendNull

func (b *Uint32Builder) AppendNull()

func (*Uint32Builder) AppendNulls

func (b *Uint32Builder) AppendNulls(n int)

func (*Uint32Builder) AppendValueFromString

func (b *Uint32Builder) AppendValueFromString(s string) error

func (*Uint32Builder) AppendValues

func (b *Uint32Builder) AppendValues(v []uint32, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Uint32Builder) Cap

func (b *Uint32Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Uint32Builder) IsNull

func (b *Uint32Builder) IsNull(i int) bool

func (*Uint32Builder) Len

func (b *Uint32Builder) Len() int

Len returns the number of elements in the array builder.

func (*Uint32Builder) NewArray

func (b *Uint32Builder) NewArray() arrow.Array

NewArray creates a Uint32 array from the memory buffers used by the builder and resets the Uint32Builder so it can be used to build a new array.

func (*Uint32Builder) NewUint32Array

func (b *Uint32Builder) NewUint32Array() (a *Uint32)

NewUint32Array creates a Uint32 array from the memory buffers used by the builder and resets the Uint32Builder so it can be used to build a new array.

func (*Uint32Builder) NullN

func (b *Uint32Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Uint32Builder) Release

func (b *Uint32Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Uint32Builder) Reserve

func (b *Uint32Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Uint32Builder) Resize

func (b *Uint32Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Uint32Builder) Retain

func (b *Uint32Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Uint32Builder) SetNull

func (b *Uint32Builder) SetNull(i int)

func (*Uint32Builder) Type

func (b *Uint32Builder) Type() arrow.DataType

func (*Uint32Builder) Unmarshal

func (b *Uint32Builder) Unmarshal(dec *json.Decoder) error

func (*Uint32Builder) UnmarshalJSON

func (b *Uint32Builder) UnmarshalJSON(data []byte) error

func (*Uint32Builder) UnmarshalOne

func (b *Uint32Builder) UnmarshalOne(dec *json.Decoder) error

func (*Uint32Builder) UnsafeAppend

func (b *Uint32Builder) UnsafeAppend(v uint32)

func (*Uint32Builder) UnsafeAppendBoolToBitmap

func (b *Uint32Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Uint32Builder) Value

func (b *Uint32Builder) Value(i int) uint32

type Uint32DictionaryBuilder

type Uint32DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Uint32DictionaryBuilder) Append

func (b *Uint32DictionaryBuilder) Append(v uint32) error

func (*Uint32DictionaryBuilder) AppendArray

func (b *Uint32DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Uint32DictionaryBuilder) AppendEmptyValue

func (b *Uint32DictionaryBuilder) AppendEmptyValue()

func (*Uint32DictionaryBuilder) AppendEmptyValues

func (b *Uint32DictionaryBuilder) AppendEmptyValues(n int)

func (*Uint32DictionaryBuilder) AppendIndices

func (b *Uint32DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Uint32DictionaryBuilder) AppendNull

func (b *Uint32DictionaryBuilder) AppendNull()

func (*Uint32DictionaryBuilder) AppendNulls

func (b *Uint32DictionaryBuilder) AppendNulls(n int)

func (*Uint32DictionaryBuilder) AppendValueFromString

func (b *Uint32DictionaryBuilder) AppendValueFromString(s string) error

func (*Uint32DictionaryBuilder) Cap

func (b *Uint32DictionaryBuilder) Cap() int

func (*Uint32DictionaryBuilder) DictionarySize

func (b *Uint32DictionaryBuilder) DictionarySize() int

func (*Uint32DictionaryBuilder) IndexBuilder

func (b *Uint32DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Uint32DictionaryBuilder) InsertDictValues

func (b *Uint32DictionaryBuilder) InsertDictValues(arr *Uint32) (err error)

func (*Uint32DictionaryBuilder) IsNull

func (b *Uint32DictionaryBuilder) IsNull(i int) bool

func (*Uint32DictionaryBuilder) NewArray

func (b *Uint32DictionaryBuilder) NewArray() arrow.Array

func (*Uint32DictionaryBuilder) NewDelta

func (b *Uint32DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Uint32DictionaryBuilder) NewDictionaryArray

func (b *Uint32DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Uint32DictionaryBuilder) Release

func (b *Uint32DictionaryBuilder) Release()

func (*Uint32DictionaryBuilder) Reserve

func (b *Uint32DictionaryBuilder) Reserve(n int)

func (*Uint32DictionaryBuilder) ResetFull

func (b *Uint32DictionaryBuilder) ResetFull()

func (*Uint32DictionaryBuilder) Resize

func (b *Uint32DictionaryBuilder) Resize(n int)

func (*Uint32DictionaryBuilder) Type

func (b *Uint32DictionaryBuilder) Type() arrow.DataType

func (*Uint32DictionaryBuilder) Unmarshal

func (b *Uint32DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Uint32DictionaryBuilder) UnmarshalJSON

func (b *Uint32DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Uint32DictionaryBuilder) UnmarshalOne

func (b *Uint32DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Uint64

type Uint64 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of uint64 values.

func NewUint64Data

func NewUint64Data(data arrow.ArrayData) *Uint64

NewUint64Data creates a new Uint64.

func (*Uint64) Data

func (a *Uint64) Data() arrow.ArrayData

func (*Uint64) DataType

func (a *Uint64) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Uint64) GetOneForMarshal

func (a *Uint64) GetOneForMarshal(i int) interface{}

func (*Uint64) IsNull

func (a *Uint64) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Uint64) IsValid

func (a *Uint64) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Uint64) Len

func (a *Uint64) Len() int

Len returns the number of elements in the array.

func (*Uint64) MarshalJSON

func (a *Uint64) MarshalJSON() ([]byte, error)

func (*Uint64) NullBitmapBytes

func (a *Uint64) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Uint64) NullN

func (a *Uint64) NullN() int

NullN returns the number of null values in the array.

func (*Uint64) Offset

func (a *Uint64) Offset() int

func (*Uint64) Release

func (a *Uint64) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Uint64) Reset

func (a *Uint64) Reset(data *Data)

Reset resets the array for re-use.

func (*Uint64) Retain

func (a *Uint64) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Uint64) String

func (a *Uint64) String() string

String returns a string representation of the array.

func (*Uint64) Uint64Values

func (a *Uint64) Uint64Values() []uint64

Values returns the values.

func (*Uint64) Value

func (a *Uint64) Value(i int) uint64

Value returns the value at the specified index.

func (*Uint64) ValueStr

func (a *Uint64) ValueStr(i int) string

type Uint64Builder

type Uint64Builder struct {
	// contains filtered or unexported fields
}

func NewUint64Builder

func NewUint64Builder(mem memory.Allocator) *Uint64Builder

func (*Uint64Builder) Append

func (b *Uint64Builder) Append(v uint64)

func (*Uint64Builder) AppendEmptyValue

func (b *Uint64Builder) AppendEmptyValue()

func (*Uint64Builder) AppendEmptyValues

func (b *Uint64Builder) AppendEmptyValues(n int)

func (*Uint64Builder) AppendNull

func (b *Uint64Builder) AppendNull()

func (*Uint64Builder) AppendNulls

func (b *Uint64Builder) AppendNulls(n int)

func (*Uint64Builder) AppendValueFromString

func (b *Uint64Builder) AppendValueFromString(s string) error

func (*Uint64Builder) AppendValues

func (b *Uint64Builder) AppendValues(v []uint64, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Uint64Builder) Cap

func (b *Uint64Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Uint64Builder) IsNull

func (b *Uint64Builder) IsNull(i int) bool

func (*Uint64Builder) Len

func (b *Uint64Builder) Len() int

Len returns the number of elements in the array builder.

func (*Uint64Builder) NewArray

func (b *Uint64Builder) NewArray() arrow.Array

NewArray creates a Uint64 array from the memory buffers used by the builder and resets the Uint64Builder so it can be used to build a new array.

func (*Uint64Builder) NewUint64Array

func (b *Uint64Builder) NewUint64Array() (a *Uint64)

NewUint64Array creates a Uint64 array from the memory buffers used by the builder and resets the Uint64Builder so it can be used to build a new array.

func (*Uint64Builder) NullN

func (b *Uint64Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Uint64Builder) Release

func (b *Uint64Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Uint64Builder) Reserve

func (b *Uint64Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Uint64Builder) Resize

func (b *Uint64Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Uint64Builder) Retain

func (b *Uint64Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Uint64Builder) SetNull

func (b *Uint64Builder) SetNull(i int)

func (*Uint64Builder) Type

func (b *Uint64Builder) Type() arrow.DataType

func (*Uint64Builder) Unmarshal

func (b *Uint64Builder) Unmarshal(dec *json.Decoder) error

func (*Uint64Builder) UnmarshalJSON

func (b *Uint64Builder) UnmarshalJSON(data []byte) error

func (*Uint64Builder) UnmarshalOne

func (b *Uint64Builder) UnmarshalOne(dec *json.Decoder) error

func (*Uint64Builder) UnsafeAppend

func (b *Uint64Builder) UnsafeAppend(v uint64)

func (*Uint64Builder) UnsafeAppendBoolToBitmap

func (b *Uint64Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Uint64Builder) Value

func (b *Uint64Builder) Value(i int) uint64

type Uint64DictionaryBuilder

type Uint64DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Uint64DictionaryBuilder) Append

func (b *Uint64DictionaryBuilder) Append(v uint64) error

func (*Uint64DictionaryBuilder) AppendArray

func (b *Uint64DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Uint64DictionaryBuilder) AppendEmptyValue

func (b *Uint64DictionaryBuilder) AppendEmptyValue()

func (*Uint64DictionaryBuilder) AppendEmptyValues

func (b *Uint64DictionaryBuilder) AppendEmptyValues(n int)

func (*Uint64DictionaryBuilder) AppendIndices

func (b *Uint64DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Uint64DictionaryBuilder) AppendNull

func (b *Uint64DictionaryBuilder) AppendNull()

func (*Uint64DictionaryBuilder) AppendNulls

func (b *Uint64DictionaryBuilder) AppendNulls(n int)

func (*Uint64DictionaryBuilder) AppendValueFromString

func (b *Uint64DictionaryBuilder) AppendValueFromString(s string) error

func (*Uint64DictionaryBuilder) Cap

func (b *Uint64DictionaryBuilder) Cap() int

func (*Uint64DictionaryBuilder) DictionarySize

func (b *Uint64DictionaryBuilder) DictionarySize() int

func (*Uint64DictionaryBuilder) IndexBuilder

func (b *Uint64DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Uint64DictionaryBuilder) InsertDictValues

func (b *Uint64DictionaryBuilder) InsertDictValues(arr *Uint64) (err error)

func (*Uint64DictionaryBuilder) IsNull

func (b *Uint64DictionaryBuilder) IsNull(i int) bool

func (*Uint64DictionaryBuilder) NewArray

func (b *Uint64DictionaryBuilder) NewArray() arrow.Array

func (*Uint64DictionaryBuilder) NewDelta

func (b *Uint64DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Uint64DictionaryBuilder) NewDictionaryArray

func (b *Uint64DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Uint64DictionaryBuilder) Release

func (b *Uint64DictionaryBuilder) Release()

func (*Uint64DictionaryBuilder) Reserve

func (b *Uint64DictionaryBuilder) Reserve(n int)

func (*Uint64DictionaryBuilder) ResetFull

func (b *Uint64DictionaryBuilder) ResetFull()

func (*Uint64DictionaryBuilder) Resize

func (b *Uint64DictionaryBuilder) Resize(n int)

func (*Uint64DictionaryBuilder) Type

func (b *Uint64DictionaryBuilder) Type() arrow.DataType

func (*Uint64DictionaryBuilder) Unmarshal

func (b *Uint64DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Uint64DictionaryBuilder) UnmarshalJSON

func (b *Uint64DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Uint64DictionaryBuilder) UnmarshalOne

func (b *Uint64DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Uint8

type Uint8 struct {
	// contains filtered or unexported fields
}

A type which represents an immutable sequence of uint8 values.

func NewUint8Data

func NewUint8Data(data arrow.ArrayData) *Uint8

NewUint8Data creates a new Uint8.

func (*Uint8) Data

func (a *Uint8) Data() arrow.ArrayData

func (*Uint8) DataType

func (a *Uint8) DataType() arrow.DataType

DataType returns the type metadata for this instance.

func (*Uint8) GetOneForMarshal

func (a *Uint8) GetOneForMarshal(i int) interface{}

func (*Uint8) IsNull

func (a *Uint8) IsNull(i int) bool

IsNull returns true if value at index is null. NOTE: IsNull will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Uint8) IsValid

func (a *Uint8) IsValid(i int) bool

IsValid returns true if value at index is not null. NOTE: IsValid will panic if NullBitmapBytes is not empty and 0 > i ≥ Len.

func (*Uint8) Len

func (a *Uint8) Len() int

Len returns the number of elements in the array.

func (*Uint8) MarshalJSON

func (a *Uint8) MarshalJSON() ([]byte, error)

func (*Uint8) NullBitmapBytes

func (a *Uint8) NullBitmapBytes() []byte

NullBitmapBytes returns a byte slice of the validity bitmap.

func (*Uint8) NullN

func (a *Uint8) NullN() int

NullN returns the number of null values in the array.

func (*Uint8) Offset

func (a *Uint8) Offset() int

func (*Uint8) Release

func (a *Uint8) Release()

Release decreases the reference count by 1. Release may be called simultaneously from multiple goroutines. When the reference count goes to zero, the memory is freed.

func (*Uint8) Reset

func (a *Uint8) Reset(data *Data)

Reset resets the array for re-use.

func (*Uint8) Retain

func (a *Uint8) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Uint8) String

func (a *Uint8) String() string

String returns a string representation of the array.

func (*Uint8) Uint8Values

func (a *Uint8) Uint8Values() []uint8

Values returns the values.

func (*Uint8) Value

func (a *Uint8) Value(i int) uint8

Value returns the value at the specified index.

func (*Uint8) ValueStr

func (a *Uint8) ValueStr(i int) string

type Uint8Builder

type Uint8Builder struct {
	// contains filtered or unexported fields
}

func NewUint8Builder

func NewUint8Builder(mem memory.Allocator) *Uint8Builder

func (*Uint8Builder) Append

func (b *Uint8Builder) Append(v uint8)

func (*Uint8Builder) AppendEmptyValue

func (b *Uint8Builder) AppendEmptyValue()

func (*Uint8Builder) AppendEmptyValues

func (b *Uint8Builder) AppendEmptyValues(n int)

func (*Uint8Builder) AppendNull

func (b *Uint8Builder) AppendNull()

func (*Uint8Builder) AppendNulls

func (b *Uint8Builder) AppendNulls(n int)

func (*Uint8Builder) AppendValueFromString

func (b *Uint8Builder) AppendValueFromString(s string) error

func (*Uint8Builder) AppendValues

func (b *Uint8Builder) AppendValues(v []uint8, valid []bool)

AppendValues will append the values in the v slice. The valid slice determines which values in v are valid (not null). The valid slice must either be empty or be equal in length to v. If empty, all values in v are appended and considered valid.

func (*Uint8Builder) Cap

func (b *Uint8Builder) Cap() int

Cap returns the total number of elements that can be stored without allocating additional memory.

func (*Uint8Builder) IsNull

func (b *Uint8Builder) IsNull(i int) bool

func (*Uint8Builder) Len

func (b *Uint8Builder) Len() int

Len returns the number of elements in the array builder.

func (*Uint8Builder) NewArray

func (b *Uint8Builder) NewArray() arrow.Array

NewArray creates a Uint8 array from the memory buffers used by the builder and resets the Uint8Builder so it can be used to build a new array.

func (*Uint8Builder) NewUint8Array

func (b *Uint8Builder) NewUint8Array() (a *Uint8)

NewUint8Array creates a Uint8 array from the memory buffers used by the builder and resets the Uint8Builder so it can be used to build a new array.

func (*Uint8Builder) NullN

func (b *Uint8Builder) NullN() int

NullN returns the number of null values in the array builder.

func (*Uint8Builder) Release

func (b *Uint8Builder) Release()

Release decreases the reference count by 1. When the reference count goes to zero, the memory is freed.

func (*Uint8Builder) Reserve

func (b *Uint8Builder) Reserve(n int)

Reserve ensures there is enough space for appending n elements by checking the capacity and calling Resize if necessary.

func (*Uint8Builder) Resize

func (b *Uint8Builder) Resize(n int)

Resize adjusts the space allocated by b to n elements. If n is greater than b.Cap(), additional memory will be allocated. If n is smaller, the allocated memory may reduced.

func (*Uint8Builder) Retain

func (b *Uint8Builder) Retain()

Retain increases the reference count by 1. Retain may be called simultaneously from multiple goroutines.

func (*Uint8Builder) SetNull

func (b *Uint8Builder) SetNull(i int)

func (*Uint8Builder) Type

func (b *Uint8Builder) Type() arrow.DataType

func (*Uint8Builder) Unmarshal

func (b *Uint8Builder) Unmarshal(dec *json.Decoder) error

func (*Uint8Builder) UnmarshalJSON

func (b *Uint8Builder) UnmarshalJSON(data []byte) error

func (*Uint8Builder) UnmarshalOne

func (b *Uint8Builder) UnmarshalOne(dec *json.Decoder) error

func (*Uint8Builder) UnsafeAppend

func (b *Uint8Builder) UnsafeAppend(v uint8)

func (*Uint8Builder) UnsafeAppendBoolToBitmap

func (b *Uint8Builder) UnsafeAppendBoolToBitmap(isValid bool)

func (*Uint8Builder) Value

func (b *Uint8Builder) Value(i int) uint8

type Uint8DictionaryBuilder

type Uint8DictionaryBuilder struct {
	// contains filtered or unexported fields
}

func (*Uint8DictionaryBuilder) Append

func (b *Uint8DictionaryBuilder) Append(v uint8) error

func (*Uint8DictionaryBuilder) AppendArray

func (b *Uint8DictionaryBuilder) AppendArray(arr arrow.Array) error

func (*Uint8DictionaryBuilder) AppendEmptyValue

func (b *Uint8DictionaryBuilder) AppendEmptyValue()

func (*Uint8DictionaryBuilder) AppendEmptyValues

func (b *Uint8DictionaryBuilder) AppendEmptyValues(n int)

func (*Uint8DictionaryBuilder) AppendIndices

func (b *Uint8DictionaryBuilder) AppendIndices(indices []int, valid []bool)

func (*Uint8DictionaryBuilder) AppendNull

func (b *Uint8DictionaryBuilder) AppendNull()

func (*Uint8DictionaryBuilder) AppendNulls

func (b *Uint8DictionaryBuilder) AppendNulls(n int)

func (*Uint8DictionaryBuilder) AppendValueFromString

func (b *Uint8DictionaryBuilder) AppendValueFromString(s string) error

func (*Uint8DictionaryBuilder) Cap

func (b *Uint8DictionaryBuilder) Cap() int

func (*Uint8DictionaryBuilder) DictionarySize

func (b *Uint8DictionaryBuilder) DictionarySize() int

func (*Uint8DictionaryBuilder) IndexBuilder

func (b *Uint8DictionaryBuilder) IndexBuilder() IndexBuilder

func (*Uint8DictionaryBuilder) InsertDictValues

func (b *Uint8DictionaryBuilder) InsertDictValues(arr *Uint8) (err error)

func (*Uint8DictionaryBuilder) IsNull

func (b *Uint8DictionaryBuilder) IsNull(i int) bool

func (*Uint8DictionaryBuilder) NewArray

func (b *Uint8DictionaryBuilder) NewArray() arrow.Array

func (*Uint8DictionaryBuilder) NewDelta

func (b *Uint8DictionaryBuilder) NewDelta() (indices, delta arrow.Array, err error)

NewDelta returns the dictionary indices and a delta dictionary since the last time NewArray or NewDictionaryArray were called, and resets the state of the builder (except for the dictionary / memotable)

func (*Uint8DictionaryBuilder) NewDictionaryArray

func (b *Uint8DictionaryBuilder) NewDictionaryArray() *Dictionary

func (*Uint8DictionaryBuilder) Release

func (b *Uint8DictionaryBuilder) Release()

func (*Uint8DictionaryBuilder) Reserve

func (b *Uint8DictionaryBuilder) Reserve(n int)

func (*Uint8DictionaryBuilder) ResetFull

func (b *Uint8DictionaryBuilder) ResetFull()

func (*Uint8DictionaryBuilder) Resize

func (b *Uint8DictionaryBuilder) Resize(n int)

func (*Uint8DictionaryBuilder) Type

func (b *Uint8DictionaryBuilder) Type() arrow.DataType

func (*Uint8DictionaryBuilder) Unmarshal

func (b *Uint8DictionaryBuilder) Unmarshal(dec *json.Decoder) error

func (*Uint8DictionaryBuilder) UnmarshalJSON

func (b *Uint8DictionaryBuilder) UnmarshalJSON(data []byte) error

func (*Uint8DictionaryBuilder) UnmarshalOne

func (b *Uint8DictionaryBuilder) UnmarshalOne(dec *json.Decoder) error

type Union

type Union interface {
	arrow.Array
	// NumFields returns the number of child fields in this union.
	// Equivalent to len(UnionType().Fields())
	NumFields() int
	// Validate returns an error if there are any issues with the lengths
	// or types of the children arrays mismatching with the Type of the
	// Union Array. nil is returned if there are no problems.
	Validate() error
	// ValidateFull runs the same checks that Validate() does, but additionally
	// checks that all childIDs are valid (>= 0 || ==InvalidID) and for
	// dense unions validates that all offsets are within the bounds of their
	// respective child.
	ValidateFull() error
	// TypeCodes returns the type id buffer for the union Array, equivalent to
	// Data().Buffers()[1]. Note: This will not account for any slice offset.
	TypeCodes() *memory.Buffer
	// RawTypeCodes returns a slice of UnionTypeCodes properly accounting for
	// any slice offset.
	RawTypeCodes() []arrow.UnionTypeCode
	// TypeCode returns the logical type code of the value at the requested index
	TypeCode(i int) arrow.UnionTypeCode
	// ChildID returns the index of the physical child containing the value
	// at the requested index. Equivalent to:
	//
	// 	arr.UnionType().ChildIDs()[arr.RawTypeCodes()[i+arr.Data().Offset()]]
	ChildID(i int) int
	// UnionType is a convenience function to retrieve the properly typed UnionType
	// instead of having to call DataType() and manually assert the type.
	UnionType() arrow.UnionType
	// Mode returns the union mode of the underlying Array, either arrow.SparseMode
	// or arrow.DenseMode.
	Mode() arrow.UnionMode
	// Field returns the requested child array for this union. Returns nil if a
	// nonexistent position is passed in.
	//
	// The appropriate child for an index can be retrieved with Field(ChildID(index))
	Field(pos int) arrow.Array
}

Union is a convenience interface to encompass both Sparse and Dense union array types.

type UnionBuilder

type UnionBuilder interface {
	Builder
	// AppendChild allows constructing the union type on the fly by making new
	// new array builder available to the union builder. The type code (index)
	// of the new child is returned, which should be passed to the Append method
	// when adding a new element to the union array.
	AppendChild(newChild Builder, fieldName string) (newCode arrow.UnionTypeCode)
	// Append adds an element to the UnionArray indicating which typecode the
	// new element should use. This *must* be followed up by an append to the
	// appropriate child builder.
	Append(arrow.UnionTypeCode)
	// Mode returns what kind of Union is being built, either arrow.SparseMode
	// or arrow.DenseMode
	Mode() arrow.UnionMode
	// Child returns the builder for the requested child index.
	// If an invalid index is requested (e.g. <0 or >len(children))
	// then this will panic.
	Child(idx int) Builder
}

UnionBuilder is a convenience interface for building Union arrays of either Dense or Sparse mode.

type VarLenListLike

type VarLenListLike interface {
	ListLike
}

type VarLenListLikeBuilder

type VarLenListLikeBuilder interface {
	ListLikeBuilder
	AppendWithSize(bool, int)
}

type ViewLike

type ViewLike interface {
	arrow.Array
	ValueHeader(int) *arrow.ViewHeader
}

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL