96f2d6fe79
Updated the pyarrow version in requirements.txt to improve compatibility. Enhanced the _infer_cluster_schema and _stream_file functions in load_folder.py and load_sas.py to return total row counts for better progress tracking during data streaming. Integrated tqdm for visual feedback on row processing, improving user experience during large data loads.
11 lines
193 B
Plaintext
11 lines
193 B
Plaintext
pandas>=2.0,<3.0
|
|
pyreadstat>=1.2,<2.0
|
|
numpy>=2.1,<3.0
|
|
pyarrow>=22.0,<24.0
|
|
pyyaml>=6.0,<7.0
|
|
psycopg2-binary>=2.9,<3.0
|
|
python-dotenv>=1.0,<2.0
|
|
boto3>=1.28,<2.0
|
|
openpyxl>=3.1,<4.0
|
|
tqdm>=4.66,<5.0
|