struct ReaderConfig {
rsp: ReadStatPath,
offsets: Vec<u32>,
parallel: bool,
column_filter: Option<Arc<BTreeMap<i32, i32>>>,
original_var_count: i32,
total_rows_processed: Arc<AtomicUsize>,
var_count: i32,
vars: Arc<BTreeMap<i32, ReadStatVarMetadata>>,
schema: Arc<Schema>,
progress: Option<Arc<IndicatifProgress>>,
wc: WriteConfig,
}Expand description
Inputs to the reader thread spawned by run_data.
Bundles the parse configuration so spawn_reader takes a single named
value rather than a long positional argument list.
Fields§
§rsp: ReadStatPathValidated input path; moves into the reader thread.
offsets: Vec<u32>Chunk boundaries from build_offsets; consumed as windows(2) pairs.
parallel: boolWhether to parse chunks concurrently on the rayon pool.
column_filter: Option<Arc<BTreeMap<i32, i32>>>Optional original-index → filtered-index column mapping.
original_var_count: i32Unfiltered variable count, for row-boundary detection under filtering.
total_rows_processed: Arc<AtomicUsize>Shared counter of rows processed across all chunks.
var_count: i32(Possibly filtered) variable count.
vars: Arc<BTreeMap<i32, ReadStatVarMetadata>>Shared variable metadata.
schema: Arc<Schema>Shared Arrow schema.
progress: Option<Arc<IndicatifProgress>>Optional progress callback.
wc: WriteConfigOutput configuration, sent alongside each chunk for the writer.
Auto Trait Implementations§
impl Freeze for ReaderConfig
impl RefUnwindSafe for ReaderConfig
impl Send for ReaderConfig
impl Sync for ReaderConfig
impl Unpin for ReaderConfig
impl UnsafeUnpin for ReaderConfig
impl UnwindSafe for ReaderConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more