David Peterson fe7dc4d5a1 Enhance load_cluster function for parallel processing and progress tracking ... Refactored the load_cluster function in load_folder.py to support parallel file loading using ProcessPoolExecutor, improving performance during the append phase. Added workers parameter for controlling parallelism and integrated a progress_queue for real-time progress updates. Introduced read_sas_metadata function in load_sas.py to efficiently read metadata from SAS files, optimizing the pre-scan process for global progress tracking.		2026-04-20 22:02:55 -05:00
..
samples	adding explorer	2026-04-20 16:27:54 -05:00
.env.example	Adding generic loader	2026-04-18 09:34:48 -05:00
generate_sample_folder.py	Add generate_sample_folder.py and load_folder.py for clustered SAS file generation and loading	2026-04-18 11:25:04 -05:00
generate_sample_sas.py	Adding generic loader	2026-04-18 09:34:48 -05:00
load_folder.py	Enhance load_cluster function for parallel processing and progress tracking	2026-04-20 22:02:55 -05:00
load_sas.py	Enhance load_cluster function for parallel processing and progress tracking	2026-04-20 22:02:55 -05:00
sample_config.yaml	adding index field	2026-04-20 10:18:09 -05:00
sample_folder_config.yaml	Enhance file clustering by implementing numeric sorting for last digit groups in stems and updating documentation for embedded-digit handling in auto-detection.	2026-04-20 11:48:22 -05:00