7beb44ac4d
Included pyarrow as a new dependency in requirements.txt for improved CSV serialization performance. Refactored the _prepare_for_copy function to utilize vectorized operations for date and timestamp conversions, reducing CPU overhead. Introduced a new _serialize_chunk_csv function leveraging pyarrow for faster CSV writing, enhancing efficiency during data copying to Postgres.
10 lines
177 B
Plaintext
10 lines
177 B
Plaintext
pandas>=2.0,<3.0
|
|
pyreadstat>=1.2,<2.0
|
|
numpy>=2.1,<3.0
|
|
pyarrow>=16.0,<21.0
|
|
pyyaml>=6.0,<7.0
|
|
psycopg2-binary>=2.9,<3.0
|
|
python-dotenv>=1.0,<2.0
|
|
boto3>=1.28,<2.0
|
|
openpyxl>=3.1,<4.0
|