Updated the pyarrow version in requirements.txt to improve compatibility. Enhanced the _infer_cluster_schema and _stream_file functions in load_folder.py and load_sas.py to return total row counts for better progress tracking during data streaming. Integrated tqdm for visual feedback on row processing, improving user experience during large data loads. |
||
|---|---|---|
| generic_loader | ||
| utils | ||
| .gitignore | ||
| requirements.txt | ||