Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: renterd multipart uploader #498

Merged
merged 1 commit into from
Feb 27, 2024
Merged

feat: renterd multipart uploader #498

merged 1 commit into from
Feb 27, 2024

Conversation

alexfreska
Copy link
Member

  • Multipart uploader class, for use within renterd's upload manager.
  • Supports configurable chunk sizes and concurrent chunks.
  • Reports combined total progress from across all concurrent requests.
  • Recovers from failed chunks with increasing backoff until success.
  • Supports aborting entire multipart upload.

@changeset-bot changeset-bot
Copy link

changeset-bot bot commented Feb 22, 2024 •
edited
Loading

⚠️ No Changeset found

Latest commit: 5e1d065

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

This was referenced Feb 22, 2024
Merged
Merged
@alexfreska
Copy link
Member Author

alexfreska commented Feb 22, 2024 •
edited
Loading

Current dependencies on/for this PR:

This stack of pull requests is managed by Graphite.

@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from e8b6e40 to 872b3ce Compare February 22, 2024 15:58
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from 872b3ce to 1ce7773 Compare February 22, 2024 16:03
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from 1ce7773 to 0a0db81 Compare February 22, 2024 19:24
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from 0a0db81 to d6f8385 Compare February 22, 2024 19:29
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from d6f8385 to aa3efe5 Compare February 22, 2024 19:36
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from aa3efe5 to 2328780 Compare February 22, 2024 21:11
@alexfreska alexfreska mentioned this pull request Feb 22, 2024
Merged
ChrisSchinnerl
ChrisSchinnerl reviewed Feb 23, 2024
View reviewed changes
apps/renterd/lib/multipartUpload.spec.ts Outdated Show resolved Hide resolved
apps/renterd/lib/multipartUpload.ts Outdated Show resolved Hide resolved
apps/renterd/lib/multipartUpload.ts Outdated Show resolved Hide resolved
apps/renterd/lib/multipartUpload.ts Outdated Show resolved Hide resolved
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from 2328780 to 5c77c0e Compare February 23, 2024 14:40
@alexfreska alexfreska mentioned this pull request Feb 23, 2024
Merged
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch 2 times, most recently from 58a29ab to 37b111a Compare February 23, 2024 18:55
@alexfreska alexfreska mentioned this pull request Feb 23, 2024
Merged
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from 37b111a to 3d93dc6 Compare February 23, 2024 22:11
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from 3d93dc6 to e161aac Compare February 24, 2024 18:35
@alexfreska alexfreska mentioned this pull request Feb 26, 2024
Merged
@alexfreska alexfreska changed the base branch from jest_private_methods to main February 27, 2024 12:58
@alexfreska alexfreska force-pushed the renterd_multipart_uploader branch from e161aac to 5e1d065 Compare February 27, 2024 13:05
@alexfreska
Copy link
Member Author

alexfreska commented Feb 27, 2024 •
edited
Loading

Merge activity

@alexfreska alexfreska merged commit 131f513 into main Feb 27, 2024
1 of 2 checks passed
@alexfreska alexfreska deleted the renterd_multipart_uploader branch June 7, 2024 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ChrisSchinnerl ChrisSchinnerl ChrisSchinnerl approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@alexfreska @ChrisSchinnerl