David Peterson
|
5645ff5597
|
Update load_sas.py to support streaming data loads with iter_sas_chunks and copy_dataframes. Enhance documentation for schema inference and type detection, clarifying the use of read_sas_preview and the implications of sampling. Add __pycache__ to .gitignore.
|
2026-04-18 10:44:32 -05:00 |
|
David Peterson
|
3a0537270c
|
Implement type inference sampling in load_sas.py to improve performance on large SAS files. Introduce TYPE_INFERENCE_SAMPLE_ROWS to limit the number of rows scanned for type detection while ensuring nullability checks cover the entire column. Update documentation to reflect these changes.
|
2026-04-18 10:28:37 -05:00 |
|
David Peterson
|
4f7ded09c6
|
Enhance load_sas.py with detailed usage instructions, YAML config structure, and command-line interface documentation for loading SAS files.
|
2026-04-18 10:20:07 -05:00 |
|
michael-corey
|
f681f1012a
|
Adding generic loader
|
2026-04-18 09:34:48 -05:00 |
|