Updated the main function to replace sequential file processing with a threaded approach using ThreadPoolExecutor. This change enhances the efficiency of reading row counts from SAS files, particularly for large datasets, by allowing concurrent I/O operations. Added progress tracking with tqdm for better user feedback during the pre-scan phase. |
||
|---|---|---|
| generic_loader | ||
| utils | ||
| .gitignore | ||
| requirements.txt | ||