Skip to main content

write_parallel_parquet

Function write_parallel_parquet 

Source
fn write_parallel_parquet(
    ctx: WriteContext,
    buffer_size_bytes: usize,
) -> Result<(), ReadStatError>
Expand description

Parallel Parquet write path (only for --parallel --parallel-write with Parquet output): write each buffered batch group to a temp file concurrently, then merge the temp files into the final output.