• Joined on 2026-04-18
dp pushed to main at OFRA/foxtrot 2026-04-23 22:33:20 +00:00
c3d1f72556 Add null string sentinel handling in load_sas.py for improved missing value detection
998a3e282f Revert "Optimize datetime parsing in load_sas.py by implementing a sample-based format detection approach"
857f696305 Optimize datetime parsing in load_sas.py by implementing a sample-based format detection approach
c3fa943e77 Enhance date and datetime parsing in load_sas.py with flexible regex and fallback formats
Compare 4 commits »
dp deleted branch advanced_dates from OFRA/foxtrot 2026-04-23 22:33:20 +00:00
dp merged pull request OFRA/foxtrot#11 2026-04-23 22:33:18 +00:00
advanced_dates
dp created pull request OFRA/foxtrot#11 2026-04-23 16:28:03 +00:00
advanced_dates
dp pushed to advanced_dates at OFRA/foxtrot 2026-04-23 00:20:09 +00:00
c3d1f72556 Add null string sentinel handling in load_sas.py for improved missing value detection
dp pushed to advanced_dates at OFRA/foxtrot 2026-04-22 18:06:05 +00:00
998a3e282f Revert "Optimize datetime parsing in load_sas.py by implementing a sample-based format detection approach"
dp pushed to advanced_dates at OFRA/foxtrot 2026-04-22 17:54:22 +00:00
857f696305 Optimize datetime parsing in load_sas.py by implementing a sample-based format detection approach
dp created branch advanced_dates in OFRA/foxtrot 2026-04-22 17:28:24 +00:00
dp pushed to advanced_dates at OFRA/foxtrot 2026-04-22 17:28:24 +00:00
c3fa943e77 Enhance date and datetime parsing in load_sas.py with flexible regex and fallback formats
dp approved OFRA/foxtrot#10 2026-04-22 15:36:05 +00:00
moving to env file
dp deleted branch fix_prescan from OFRA/foxtrot 2026-04-22 15:35:25 +00:00
dp merged pull request OFRA/foxtrot#9 2026-04-22 15:35:20 +00:00
Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py
dp pushed to main at OFRA/foxtrot 2026-04-22 15:35:20 +00:00
0632e110e5 Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py
dp created pull request OFRA/foxtrot#9 2026-04-22 15:19:20 +00:00
Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py
dp approved OFRA/foxtrot#7 2026-04-22 14:38:03 +00:00
adding exception counter
dp created branch fix_prescan in OFRA/foxtrot 2026-04-22 02:43:47 +00:00
dp pushed to fix_prescan at OFRA/foxtrot 2026-04-22 02:43:47 +00:00
dd83f58412 Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py
dp deleted branch advanced_analyzer from OFRA/foxtrot 2026-04-21 22:32:27 +00:00
dp pushed to main at OFRA/foxtrot 2026-04-21 22:32:20 +00:00
64e7ff0b0a Enhance error reporting in load_folder.py and load_sas.py for better debugging
eff82c73ce Add all_nullable configuration option in load_folder.py and load_sas.py for flexible schema management
c283b42876 Add safe numeric to datetime conversion in load_sas.py to handle edge cases
a46f0518f6 Suppress PerformanceWarning in load_sas.py to reduce noise during processing of wide SAS files. This change filters out warnings related to DataFrame fragmentation, which are irrelevant for our pipeline as we directly convert DataFrames to pyarrow tables.
969a442775 Refactor numeric column type inference in load_sas.py for improved data handling
Compare 23 commits »
dp merged pull request OFRA/foxtrot#8 2026-04-21 22:32:18 +00:00
advanced_analyzer