foxtrot/generic_loader
David Peterson c3d1f72556 Add null string sentinel handling in load_sas.py for improved missing value detection
Introduced a frozenset of string literals that represent SQL NULL values, enhancing the inference and nullability detection processes. Implemented helper functions to identify null strings and unify missing value checks for CHAR/TEXT columns. Updated the _null_sentinel_mask function to replace these sentinel values with None, ensuring consistent handling across various data types during data loading. This change improves robustness in managing missing data scenarios.
2026-04-22 19:20:07 -05:00
..
samples adding explorer 2026-04-20 16:27:54 -05:00
.env.example moving to env file 2026-04-22 15:37:35 +00:00
generate_sample_folder.py Add generate_sample_folder.py and load_folder.py for clustered SAS file generation and loading 2026-04-18 11:25:04 -05:00
generate_sample_sas.py Adding generic loader 2026-04-18 09:34:48 -05:00
load_folder.py Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py 2026-04-22 15:35:19 +00:00
load_sas.py Add null string sentinel handling in load_sas.py for improved missing value detection 2026-04-22 19:20:07 -05:00
sample_config.yaml adding text file support 2026-04-21 20:05:26 -05:00
sample_folder_config.yaml adding text file support 2026-04-21 20:05:26 -05:00