dp

0 Followers · 1 Following

• Joined on 2026-04-18

Repositories Projects Packages Public Activity Starred Repositories

dp pushed to main at OFRA/foxtrot 2026-04-23 22:33:20 +00:00

c3d1f72556 Add null string sentinel handling in load_sas.py for improved missing value detection

998a3e282f Revert "Optimize datetime parsing in load_sas.py by implementing a sample-based format detection approach"

857f696305 Optimize datetime parsing in load_sas.py by implementing a sample-based format detection approach

c3fa943e77 Enhance date and datetime parsing in load_sas.py with flexible regex and fallback formats

Compare 4 commits »

dp deleted branch advanced_dates from OFRA/foxtrot 2026-04-23 22:33:20 +00:00

dp merged pull request OFRA/foxtrot#11 2026-04-23 22:33:18 +00:00

advanced_dates

dp created pull request OFRA/foxtrot#11 2026-04-23 16:28:03 +00:00

advanced_dates

dp pushed to advanced_dates at OFRA/foxtrot 2026-04-23 00:20:09 +00:00

c3d1f72556 Add null string sentinel handling in load_sas.py for improved missing value detection

dp pushed to advanced_dates at OFRA/foxtrot 2026-04-22 18:06:05 +00:00

998a3e282f Revert "Optimize datetime parsing in load_sas.py by implementing a sample-based format detection approach"

dp pushed to advanced_dates at OFRA/foxtrot 2026-04-22 17:54:22 +00:00

857f696305 Optimize datetime parsing in load_sas.py by implementing a sample-based format detection approach

dp created branch advanced_dates in OFRA/foxtrot 2026-04-22 17:28:24 +00:00

dp pushed to advanced_dates at OFRA/foxtrot 2026-04-22 17:28:24 +00:00

c3fa943e77 Enhance date and datetime parsing in load_sas.py with flexible regex and fallback formats

dp approved OFRA/foxtrot#10 2026-04-22 15:36:05 +00:00

moving to env file

dp deleted branch fix_prescan from OFRA/foxtrot 2026-04-22 15:35:25 +00:00

dp merged pull request OFRA/foxtrot#9 2026-04-22 15:35:20 +00:00

Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py

dp pushed to main at OFRA/foxtrot 2026-04-22 15:35:20 +00:00

0632e110e5 Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py

dp created pull request OFRA/foxtrot#9 2026-04-22 15:19:20 +00:00

Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py

dp approved OFRA/foxtrot#7 2026-04-22 14:38:03 +00:00

adding exception counter

dp created branch fix_prescan in OFRA/foxtrot 2026-04-22 02:43:47 +00:00

dp pushed to fix_prescan at OFRA/foxtrot 2026-04-22 02:43:47 +00:00

dd83f58412 Implement parallel processing for partition discovery in load_folder.py and enhance column filtering in load_sas.py

dp deleted branch advanced_analyzer from OFRA/foxtrot 2026-04-21 22:32:27 +00:00

dp pushed to main at OFRA/foxtrot 2026-04-21 22:32:20 +00:00

64e7ff0b0a Enhance error reporting in load_folder.py and load_sas.py for better debugging

eff82c73ce Add all_nullable configuration option in load_folder.py and load_sas.py for flexible schema management

c283b42876 Add safe numeric to datetime conversion in load_sas.py to handle edge cases

a46f0518f6 Suppress PerformanceWarning in load_sas.py to reduce noise during processing of wide SAS files. This change filters out warnings related to DataFrame fragmentation, which are irrelevant for our pipeline as we directly convert DataFrames to pyarrow tables.

969a442775 Refactor numeric column type inference in load_sas.py for improved data handling

Compare 23 commits »

dp merged pull request OFRA/foxtrot#8 2026-04-21 22:32:18 +00:00

advanced_analyzer