Go to file
David Peterson fe7dc4d5a1 Enhance load_cluster function for parallel processing and progress tracking
Refactored the load_cluster function in load_folder.py to support parallel file loading using ProcessPoolExecutor, improving performance during the append phase. Added workers parameter for controlling parallelism and integrated a progress_queue for real-time progress updates. Introduced read_sas_metadata function in load_sas.py to efficiently read metadata from SAS files, optimizing the pre-scan process for global progress tracking.
2026-04-20 22:02:55 -05:00
generic_loader Enhance load_cluster function for parallel processing and progress tracking 2026-04-20 22:02:55 -05:00
utils Refine partition name patterns in sas_profiler.py 2026-04-20 19:27:01 -05:00
.gitignore adding explorer 2026-04-20 16:27:54 -05:00
requirements.txt Update requirements and enhance SAS file processing with progress tracking 2026-04-20 21:44:49 -05:00