Refactor download function for robustness and retries#15933
Conversation
Updated the download function to use requests for robust streaming with retries and improved error handling.
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15933
Note: Links to docs will display an error until the docs builds have been completed. ⏳ No Failures, 37 PendingAs of commit de5ca1c with merge base b4d72f1 ( This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This PR needs a
|
Added requests library and HTTPAdapter for improved HTTP handling.
It's not compatible with #15933 which cause 2^70+ byte counters like ``` Downloaded: 839890544179019776 / 1354151797 bytes (62023367397.93%) Downloaded: 841813590016000000 / 1354151797 bytes (62165378496.04%) ```
It's not compatible with #15933 which cause 2^70+ byte counters like ``` Downloaded: 839890544179019776 / 1354151797 bytes (62023367397.93%) Downloaded: 841813590016000000 / 1354151797 bytes (62165378496.04%) ```
It's not compatible with pytorch#15933 which cause 2^70+ byte counters like ``` Downloaded: 839890544179019776 / 1354151797 bytes (62023367397.93%) Downloaded: 841813590016000000 / 1354151797 bytes (62165378496.04%) ```
It seems like download logic is unstable. Updated the download function to use requests for robust streaming with retries and improved error handling.