Expand description
Output writers for converting Arrow RecordBatch data
to CSV, Feather (Arrow IPC), NDJSON, or Parquet format.
ReadStatWriter manages the lifecycle of format-specific writers, handling
streaming writes across multiple batches. It also supports metadata output
(pretty-printed or JSON) and parallel Parquet writes via temporary files.
Structsยง
- Read
Stat ๐Parquet Writer - Internal wrapper around the Parquet Arrow writer, allowing ownership transfer on close.
- Read
Stat Writer - Manages writing Arrow [
RecordBatch] data to the configured output format.
Enumsยง
- Read
Stat ๐Writer Format - Format-specific writer variant, created lazily on first write.
Functionsยง
- format_
with_ ๐commas - Formats a number with comma thousands separators (e.g. 1081 -> โ1,081โ).
- write_
batch_ to_ csv_ bytes - Serialize a
RecordBatchto CSV bytes (with header). - write_
batch_ to_ feather_ bytes - Serialize a
RecordBatchto Feather (Arrow IPC) bytes. - write_
batch_ to_ ndjson_ bytes - Serialize a
RecordBatchto NDJSON bytes. - write_
batch_ to_ parquet_ bytes - Serialize a
RecordBatchto Parquet bytes with Snappy compression.