-
Notifications
You must be signed in to change notification settings - Fork 217
Closed
Labels
Description
Initial checklist
- I understand this is a bug report and questions should be posted in the Community Forum
- I searched issues and couldn’t find anything (or linked relevant results below)
Steps to reproduce
- Upload a file of larger size such as 200GB
- Choose an appropriate part size (32MB)
- Enable logs so that part number is shown after each upload
Expected behavior
The upload should complete without issue as 32MB parts is sufficient for 200GB without hitting the 10000 part limit.
Actual behavior
Before we finish the upload we will get an error "InvalidArgument: Part number must be an integer between 1 and 10000, inclusive" from S3 because our part number is 10002.
Looking through the code I can see that the partNumber is actually incremented twice, which is why we hit the part number limit early, and why it complains about 10002.
First place we increment the part
| const nextPartNumber = partNumber + 1 |
Then before we upload the chunk we increment the part number again
| const partNumber = currentPartNumber + 1 |
1nstinct, fenos and juliusrennerbosch