foxtrot/generic_loader
David Peterson 969a442775 Refactor numeric column type inference in load_sas.py for improved data handling
Updated the logic for determining column types in the union_column_types function. Changed the default type from BIGINT to DOUBLE PRECISION for numeric columns without explicit format hints, ensuring better handling of both integer and float values. This adjustment prevents loading failures due to format discrepancies and maintains consistent data processing across various SAS formats.
2026-04-21 13:17:01 -05:00
..
samples adding explorer 2026-04-20 16:27:54 -05:00
.env.example Adding generic loader 2026-04-18 09:34:48 -05:00
generate_sample_folder.py Add generate_sample_folder.py and load_folder.py for clustered SAS file generation and loading 2026-04-18 11:25:04 -05:00
generate_sample_sas.py Adding generic loader 2026-04-18 09:34:48 -05:00
load_folder.py Enhance error handling and abort functionality in load_folder.py for parallel file loading 2026-04-21 12:54:05 -05:00
load_sas.py Refactor numeric column type inference in load_sas.py for improved data handling 2026-04-21 13:17:01 -05:00
sample_config.yaml Add column type overrides in load_folder.py and load_sas.py for enhanced schema control 2026-04-21 12:14:44 -05:00
sample_folder_config.yaml Add column type overrides in load_folder.py and load_sas.py for enhanced schema control 2026-04-21 12:14:44 -05:00