advanced_dates #11

Merged
dp merged 4 commits from advanced_dates into main 2026-04-23 22:33:18 +00:00
Contributor
No description provided.
dp added 4 commits 2026-04-23 16:28:03 +00:00
Introduced a locale-independent month lookup and improved date parsing functions to handle various date formats, including SAS and Oracle styles. The new _parse_flexible_date and _parse_flexible_datetime functions provide robust parsing capabilities, accommodating both date-only and datetime inputs. Updated _try_date_coerce and _try_datetime_coerce to utilize these new functions, ensuring better handling of diverse date formats during data loading.
Introduced a new mechanism to sample non-null values for determining the appropriate datetime parsing strategy, significantly reducing processing time for large datasets. This change replaces the previous full row-walk method with a more efficient sampling technique, enhancing performance while maintaining robust handling of various date formats. Updated comments for clarity on the new approach.
This reverts commit 857f696305.
Introduced a frozenset of string literals that represent SQL NULL values, enhancing the inference and nullability detection processes. Implemented helper functions to identify null strings and unify missing value checks for CHAR/TEXT columns. Updated the _null_sentinel_mask function to replace these sentinel values with None, ensuring consistent handling across various data types during data loading. This change improves robustness in managing missing data scenarios.
dp requested review from mc 2026-04-23 16:28:08 +00:00
mc approved these changes 2026-04-23 22:32:08 +00:00
dp merged commit c3d1f72556 into main 2026-04-23 22:33:18 +00:00
dp deleted branch advanced_dates 2026-04-23 22:33:18 +00:00
Sign in to join this conversation.
No reviewers
mc
No Label
No Milestone
No project
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: OFRA/foxtrot#11
No description provided.