Go to file
David Peterson 052fb0e087 Refactor pre-scan process in load_folder.py to utilize ThreadPoolExecutor for improved performance
Updated the main function to replace sequential file processing with a threaded approach using ThreadPoolExecutor. This change enhances the efficiency of reading row counts from SAS files, particularly for large datasets, by allowing concurrent I/O operations. Added progress tracking with tqdm for better user feedback during the pre-scan phase.
2026-04-20 22:43:02 -05:00
generic_loader Refactor pre-scan process in load_folder.py to utilize ThreadPoolExecutor for improved performance 2026-04-20 22:43:02 -05:00
utils Refine partition name patterns in sas_profiler.py 2026-04-20 19:27:01 -05:00
.gitignore adding explorer 2026-04-20 16:27:54 -05:00
requirements.txt Update requirements and enhance SAS file processing with progress tracking 2026-04-20 21:44:49 -05:00