Skip to main content

Module rs_data

Module rs_data 

Source
Expand description

Data reading and Arrow [RecordBatch] conversion.

ReadStatData coordinates the FFI parsing of row values from a .sas7bdat file, accumulating them directly into typed Arrow builders via the handle_value callback, then finishing them into an Arrow RecordBatch for downstream writing. Supports streaming chunks with configurable row offsets and progress tracking.

Structsยง

ReadStatData
Holds parsed row data from a .sas7bdat file and converts it to Arrow format.
StreamingData ๐Ÿ”’
Callback context used by the high-level reader to rotate builders while a single ReadStat parse is in progress.

Enumsยง

ColumnBuilder ๐Ÿ”’
A typed Arrow array builder for a single column.

Constantsยง

MAX_PREALLOC_ROWS ๐Ÿ”’
Upper bound on the row capacity pre-allocated for Arrow builders.
MAX_STRING_COLUMN_PREALLOC_BYTES ๐Ÿ”’
Maximum share of the aggregate reservation assigned to one string column.
MAX_STRING_PREALLOC_BYTES ๐Ÿ”’
Maximum initial value-byte reservation across all string columns.
MAX_STRING_PREALLOC_ROWS ๐Ÿ”’
Maximum aggregate initial row capacity across all string columns.

Functionsยง

string_column_byte_budget ๐Ÿ”’
string_column_row_budget ๐Ÿ”’
string_value_capacity ๐Ÿ”’