David Peterson 9afb52aecb Add --chunk-rows option to load_folder.py for customizable memory management ... Introduced a new command-line argument, --chunk-rows, allowing users to specify the number of rows per chunk for pyreadstat streaming and COPY operations. This option overrides the GENERIC_LOADER_CHUNK_ROWS environment variable and auto-scaling behavior when using multiple workers. Enhanced memory management by providing detailed information on peak memory usage based on the specified chunk size, improving performance and usability during large dataset processing.		2026-04-21 10:05:21 -05:00
generic_loader	Add --chunk-rows option to load_folder.py for customizable memory management	2026-04-21 10:05:21 -05:00
utils	Refine partition name patterns in sas_profiler.py	2026-04-20 19:27:01 -05:00
.gitignore	adding explorer	2026-04-20 16:27:54 -05:00
requirements.txt	Update requirements and enhance SAS file processing with progress tracking	2026-04-20 21:44:49 -05:00