Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixes #673, IA-S3 check_limit error message bug. #674

Merged
merged 2 commits into from
Jan 10, 2025

Conversation

jjjake
Copy link
Owner

@jjjake jjjake commented Jan 10, 2025

Fixed bug where failed requests to IA-S3 check_limit API would be treated as a 503 slowdown error.

Fixed bug where failed requests to IA-S3 check_limit API would be treated as a 503 slowdown error.
@jjjake
Copy link
Owner Author

jjjake commented Jan 10, 2025

Here's an example of what the output would look like in ia upload for a read-timeout from the IA-S3 check_limit API:

» ia upload jj-test-2024-12-10 internetarchive-5.0.5.tar.gz -H 'X-Archive-Simulate-Error:SlowDown' --retries 3 --sleep 1
jj-test-2024-12-10:
 uploading internetarchive-5.0.5.tar.gz: 100%|████████████████████████████████████████████████| 1/1 [00:00<00:00, 25.01MiB/s]
 warning: s3 is overloaded, sleeping for 1 seconds and retrying. 3 retries left.
 warning: error checking if s3 is overloaded via s3.us.archive.org?check_limit=1, exception raised: "Fake ReadTimeout error: The read operation timed out.". sleeping for 1 seconds and retrying. 2 retries left.
 warning: error checking if s3 is overloaded via s3.us.archive.org?check_limit=1, exception raised: "Fake ReadTimeout error: The read operation timed out.". sleeping for 1 seconds and retrying. 1 retries left.
 uploading internetarchive-5.0.5.tar.gz: 100%|████████████████████████████████████████████████| 1/1 [00:00<00:00, 41.87MiB/s]
 error uploading internetarchive-5.0.5.tar.gz: Please reduce your request rate. - simulated error caused by x-(amz|archive)-simulate-error, try x-archive-simulate-error:help

@jjjake jjjake merged commit 88b695b into master Jan 10, 2025
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant