foxtrot/generic_loader
David Peterson 212218fb67 Enhance error handling and abort functionality in load_folder.py for parallel file loading
Implemented an `--abort-on-first-failure` option in the `_load_remaining_files_parallel` function, allowing users to cancel all pending tasks immediately upon the first worker failure. This change improves user experience by providing real-time feedback on errors through stderr, ensuring that users are promptly informed of issues without waiting for all tasks to complete. Additionally, refined error reporting to maintain accurate summaries of successes and failures, even during interruptions.
2026-04-21 12:54:05 -05:00
..
samples adding explorer 2026-04-20 16:27:54 -05:00
.env.example Adding generic loader 2026-04-18 09:34:48 -05:00
generate_sample_folder.py Add generate_sample_folder.py and load_folder.py for clustered SAS file generation and loading 2026-04-18 11:25:04 -05:00
generate_sample_sas.py Adding generic loader 2026-04-18 09:34:48 -05:00
load_folder.py Enhance error handling and abort functionality in load_folder.py for parallel file loading 2026-04-21 12:54:05 -05:00
load_sas.py Add column type overrides in load_folder.py and load_sas.py for enhanced schema control 2026-04-21 12:14:44 -05:00
sample_config.yaml Add column type overrides in load_folder.py and load_sas.py for enhanced schema control 2026-04-21 12:14:44 -05:00
sample_folder_config.yaml Add column type overrides in load_folder.py and load_sas.py for enhanced schema control 2026-04-21 12:14:44 -05:00