S3: Content length error on put object request #5807
Labels
bug
This issue is a bug.
closing-soon
This issue will close in 4 days unless further comments are made.
p1
This is a high priority issue
potential-regression
Marking this issue as a potential regression to be checked by team member
Comments
toon-borgers-hs
added
bug
toon-borgers-hs
changed the title
bhoradc
added
p1
|
Hi @toon-borgers-hs, Thank you for reporting the issue. I am able to reproduce the exception with AWS S3 endpoint as well with version This looks related to Minimal reproducible code snippet public static void upload() {
var bucket = "<<bucketname";
var contentLength = 20 * 1024 * 1024;
var random = new Random();
var randomData = new byte[contentLength];
random.nextBytes(randomData);
var client =
S3AsyncClient.builder()
.region(Region.of("us-east-1"))
.multipartEnabled(true)
.build();
var transferManager = S3TransferManager.builder().s3Client(client).build();
ExecutorService executor = Executors.newSingleThreadExecutor();
try (var stream = new ByteArrayInputStream(randomData)) {
var uploadRequest = UploadRequest.builder()
.putObjectRequest(
b ->
b.bucket(bucket)
.key("key")
.contentType("text/plain")
.contentLength((long) contentLength))
.requestBody(
AsyncRequestBody.fromInputStream(
b ->
b.inputStream(stream)
.contentLength((long) contentLength)
.executor(executor)))
.build();
transferManager
.upload(uploadRequest)
.completionFuture()
.join();
} catch (IOException e) {
throw new RuntimeException(e);
}
finally {
executor.shutdown();
try {
executor.awaitTermination(1, TimeUnit.MINUTES);
} catch (InterruptedException e) {
throw new RuntimeException(e);
}
transferManager.close();
}
}We are looking further into this. Regards, |
12 tasks
|
Hi @toon-borgers-hs we released a fix in |
zoewangg
added
the
closing-soon
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
Since version
2.30.1, I'm getting an error when I do a put request using multipart upload and the transfer manager. If I pass thecontentLengthparameter in the put object request, I get an error likeRequest content was only 4196352 bytes, but the specified content-length was 20981796 bytes.I don't get this if I leave the content length parameter off of the put object request.
I'm also setting it on the request body, but there it's not causing an issue.
Regression Issue
Expected Behavior
The upload should still work as before 2.30.1
Current Behavior
I get an error:
Reproduction Steps
Possible Solution
No response
Additional Information/Context
No response
AWS Java SDK version used
2.30.1
JDK version used
openjdk 23 2024-09-17 OpenJDK Runtime Environment (build 23+37-2369) OpenJDK 64-Bit Server VM (build 23+37-2369, mixed mode, sharing)
Operating System and version
MacOS 15.0.1 (24A348)
The text was updated successfully, but these errors were encountered: