Introduced a new script `s3_download.py` for downloading files from S3 based on a YAML configuration. The script supports recursive listing, file clustering, and customizable download behavior. Also added a sample configuration file `sample_s3_download_config.yaml` to demonstrate usage. |
||
|---|---|---|
| generic_loader | ||
| utils | ||
| requirements.txt | ||