Skip to content

Conversation

@zhtttylz
Copy link
Contributor

Description of PR

HADOOP-19731. Fix SpotBugs warnings introduced after SpotBugs version upgrade.

How was this patch tested?

Ran mvn -Dspotbugs.skip=false spotbugs:spotbugs on affected modules and verified the build no longer fails on SpotBugs warnings. No functional code changes, config-only.

For code changes:

  • Add a project-wide baseline at dev-support/findbugs-exclude-global.xml.
  • Consolidate SpotBugs plugin config in affected module POMs to consistently include local excludes and the new global baseline.
  • Wire the global baseline from hadoop-project-dist/pom.xml; introduce a root path property to reference the repository root.

@slfan1989
Copy link
Contributor

@zhtttylz Thank you for following up on this issue.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 29s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 8m 39s Maven dependency ordering for branch
+1 💚 mvninstall 15m 41s trunk passed
+1 💚 compile 8m 19s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 compile 8m 22s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
-1 ❌ mvnsite 6m 23s /branch-mvnsite-root.txt root in trunk failed.
+1 💚 javadoc 5m 21s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javadoc 4m 44s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 shadedclient 71m 43s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 24s Maven dependency ordering for patch
+1 💚 mvninstall 25m 51s the patch passed
+1 💚 compile 8m 1s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javac 8m 1s the patch passed
+1 💚 compile 8m 20s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 javac 8m 20s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-1 ❌ mvnsite 3m 41s /patch-mvnsite-root.txt root in the patch failed.
+1 💚 javadoc 5m 15s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javadoc 4m 38s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 shadedclient 28m 29s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 589m 16s /patch-unit-root.txt root in the patch passed.
-1 ❌ asflicense 0m 48s /results-asflicense.txt The patch generated 1 ASF License warnings.
734m 52s
Reason Tests
Failed junit tests hadoop.yarn.server.router.subcluster.capacity.TestYarnFederationWithCapacityScheduler
hadoop.security.ssl.TestDelegatingSSLSocketFactory
hadoop.yarn.sls.appmaster.TestAMSimulator
hadoop.hdfs.TestDecommission
hadoop.hdfs.tools.TestDFSAdmin
Subsystem Report/Notes
Docker ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/2/artifact/out/Dockerfile
GITHUB PR #8053
Optional Tests dupname asflicense codespell detsecrets xmllint compile javac javadoc mvninstall mvnsite unit shadedclient
uname Linux 2197de4c49c9 5.15.0-156-generic #166-Ubuntu SMP Sat Aug 9 00:02:46 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / c46c6af
Default Java Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Multi-JDK versions /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/2/testReport/
Max. process+thread count 4391 (vs. ulimit of 5500)
modules C: hadoop-project-dist hadoop-common-project/hadoop-minikdc hadoop-common-project/hadoop-auth hadoop-common-project/hadoop-nfs hadoop-common-project/hadoop-kms hadoop-common-project/hadoop-registry hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-yarn-project/hadoop-yarn hadoop-mapreduce-project/hadoop-mapreduce-client hadoop-mapreduce-project/hadoop-mapreduce-examples hadoop-mapreduce-project hadoop-tools/hadoop-streaming hadoop-tools/hadoop-archive-logs hadoop-tools/hadoop-rumen hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-datajoin hadoop-tools/hadoop-aws hadoop-tools/hadoop-azure hadoop-tools/hadoop-aliyun hadoop-tools/hadoop-sls hadoop-tools/hadoop-fs2img hadoop-tools/hadoop-gcp hadoop-tools/hadoop-benchmark hadoop-cloud-storage-project/hadoop-cos hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-tos . U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/2/console
versions git=2.25.1 maven=3.9.11
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ docker 14m 34s Docker failed to build run-specific yetus/hadoop:tp-29464}.
Subsystem Report/Notes
GITHUB PR #8053
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/4/console
versions git=2.34.1
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@slfan1989
Copy link
Contributor

@steveloughran @szetszwo We propose adding a global configuration to temporarily suppress the warnings generated by the new rules introduced in SpotBugs 4.9.7. Would this approach be acceptable to you?

@szetszwo
Copy link
Contributor

... adding a global configuration to temporarily suppress the warnings generated by the new rules introduced in SpotBugs 4.9.7. ...

@slfan1989, @zhtttylz , it sounds good. Thanks a lot for fixing the warnings!

@zhtttylz zhtttylz marked this pull request as ready for review November 16, 2025 03:10
@steveloughran
Copy link
Contributor

suppressing the new reports would be mostly good (they are overreactions/false alarms), we may lose some real issues on the way.

Copy link
Contributor

@steveloughran steveloughran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

a lot of the java changes are just removing trailing spaces. Is this needed? I knowe it's not ideal to have these, but it makes for a bigger patch and cherrypicking harder. I treat them like out-of-order imports: something I leave alone except when editing the specific lines.

spotify doesn't complain about these lines, does it?

@zhtttylz
Copy link
Contributor Author

a lot of the java changes are just removing trailing spaces. Is this needed? I knowe it's not ideal to have these, but it makes for a bigger patch and cherrypicking harder. I treat them like out-of-order imports: something I leave alone except when editing the specific lines.

spotify doesn't complain about these lines, does it?

@steveloughran Thanks for the review — your point about keeping the patch small for easier cherry-picks makes sense. I’ve dropped the trailing-whitespace cleanup and introduced pattern-level filters for the new 4.9.7 rules so we reduce noise while still surfacing real issues.

The CI: trigger SpotBugs (no-op) commit is only there to force SpotBugs to run in pre-commit (CI skips SpotBugs when there are no .java changes). Once the new configuration is validated, I’ll drop that no-op commit so it doesn’t end up in the final patch.

With the current revision, the pre-commit SpotBugs summary (PR-8053/10 at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/10/consoleText) reports 0 new findings and only fixed issues across the modules, for example:

SpotBugs patch summary from PR-8053/9
  hadoop-common-project/hadoop-common generated 0 new + 0 unchanged - 448 fixed = 0 total (was 448)

  hadoop-hdfs-project/hadoop-hdfs-client generated 0 new + 0 unchanged - 2801 fixed = 0 total (was 2801)

  hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager generated 0 new + 1 unchanged - 1298 fixed = 1 total (was 1299)

Copy link
Contributor

@slfan1989 slfan1989 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I generally agree with this PR, but there are a few minor issues.

/**
* The contract of OBS: only enabled if the test bucket is provided.
*/
// CI: trigger SpotBugs (no-op)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need this change?

return config;
}
}
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this change be avoided as well?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you very much for taking the time to review this. The CI result from PR-8053/10 has already validated the new SpotBugs configuration, so I will reset that temporary commit to ensure this PR no longer includes the comment-only or formatting-only changes.

@github-actions github-actions bot removed the RBF label Nov 29, 2025
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 1m 13s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 7m 37s Maven dependency ordering for branch
+1 💚 mvninstall 34m 36s trunk passed
+1 💚 compile 18m 29s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 compile 19m 43s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 mvnsite 22m 20s trunk passed
+1 💚 javadoc 18m 31s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javadoc 17m 9s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 shadedclient 171m 11s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 34s Maven dependency ordering for patch
+1 💚 mvninstall 26m 44s the patch passed
+1 💚 compile 19m 42s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javac 19m 42s the patch passed
+1 💚 compile 21m 45s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 javac 21m 45s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 mvnsite 23m 37s the patch passed
+1 💚 javadoc 18m 58s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javadoc 18m 28s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 shadedclient 95m 29s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 24s hadoop-project in the patch passed.
+1 💚 unit 0m 22s hadoop-project-dist in the patch passed.
+1 💚 unit 0m 35s hadoop-minikdc in the patch passed.
+1 💚 unit 3m 33s hadoop-auth in the patch passed.
+1 💚 unit 0m 35s hadoop-nfs in the patch passed.
+1 💚 unit 3m 25s hadoop-kms in the patch passed.
+1 💚 unit 1m 27s hadoop-registry in the patch passed.
+1 💚 unit 5m 22s hadoop-hdfs-httpfs in the patch passed.
+1 💚 unit 3m 26s hadoop-hdfs-nfs in the patch passed.
-1 ❌ unit 270m 43s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch passed.
+1 💚 unit 142m 36s hadoop-mapreduce-client in the patch passed.
+1 💚 unit 1m 25s hadoop-mapreduce-examples in the patch passed.
+1 💚 unit 141m 50s hadoop-mapreduce-project in the patch passed.
+1 💚 unit 7m 7s hadoop-streaming in the patch passed.
+1 💚 unit 1m 32s hadoop-archive-logs in the patch passed.
+1 💚 unit 1m 5s hadoop-rumen in the patch passed.
+1 💚 unit 16m 0s hadoop-gridmix in the patch passed.
+1 💚 unit 1m 12s hadoop-datajoin in the patch passed.
-1 ❌ unit 1m 41s /patch-unit-hadoop-tools_hadoop-sls.txt hadoop-sls in the patch passed.
+1 💚 unit 1m 10s hadoop-fs2img in the patch passed.
+1 💚 unit 3m 57s hadoop-azure in the patch passed.
-1 ❌ unit 3m 59s /patch-unit-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch passed.
+1 💚 unit 0m 59s hadoop-aliyun in the patch passed.
+1 💚 unit 0m 58s hadoop-benchmark in the patch passed.
+1 💚 unit 1m 5s hadoop-gcp in the patch passed.
+1 💚 unit 1m 2s hadoop-cos in the patch passed.
+1 💚 unit 1m 1s hadoop-huaweicloud in the patch passed.
+1 💚 unit 2m 11s hadoop-tos in the patch passed.
-1 ❌ asflicense 1m 31s /results-asflicense.txt The patch generated 2 ASF License warnings.
963m 7s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.TestRMHA
hadoop.yarn.server.router.subcluster.fair.TestYarnFederationWithFairScheduler
hadoop.yarn.sls.appmaster.TestAMSimulator
hadoop.fs.s3a.TestS3AUnbuffer
hadoop.fs.s3a.impl.streams.TestStreamFactories
Subsystem Report/Notes
Docker ClientAPI=1.52 ServerAPI=1.52 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/11/artifact/out/Dockerfile
GITHUB PR #8053
Optional Tests dupname asflicense codespell detsecrets xmllint compile javac javadoc mvninstall mvnsite unit shadedclient
uname Linux 97c6fc16637a 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 6414293
Default Java Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Multi-JDK versions /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/11/testReport/
Max. process+thread count 1778 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-project-dist hadoop-common-project/hadoop-minikdc hadoop-common-project/hadoop-auth hadoop-common-project/hadoop-nfs hadoop-common-project/hadoop-kms hadoop-common-project/hadoop-registry hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-hdfs-project/hadoop-hdfs-nfs hadoop-yarn-project/hadoop-yarn hadoop-mapreduce-project/hadoop-mapreduce-client hadoop-mapreduce-project/hadoop-mapreduce-examples hadoop-mapreduce-project hadoop-tools/hadoop-streaming hadoop-tools/hadoop-archive-logs hadoop-tools/hadoop-rumen hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-datajoin hadoop-tools/hadoop-sls hadoop-tools/hadoop-fs2img hadoop-tools/hadoop-azure hadoop-tools/hadoop-aws hadoop-tools/hadoop-aliyun hadoop-tools/hadoop-benchmark hadoop-tools/hadoop-gcp hadoop-cloud-storage-project/hadoop-cos hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-tos U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/11/console
versions git=2.25.1 maven=3.9.11
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@@ -0,0 +1,56 @@
<?xml version="1.0" encoding="UTF-8"?>
<FindBugsFilter>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to add the Apache License notice.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the feedback—I’ll make the updates right away!

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 42s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 6m 33s Maven dependency ordering for branch
+1 💚 mvninstall 15m 10s trunk passed
+1 💚 compile 8m 48s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 compile 8m 48s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 mvnsite 12m 19s trunk passed
+1 💚 javadoc 10m 47s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javadoc 9m 23s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 shadedclient 86m 8s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 19s Maven dependency ordering for patch
+1 💚 mvninstall 11m 44s the patch passed
+1 💚 compile 8m 30s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javac 8m 30s the patch passed
+1 💚 compile 8m 41s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 javac 8m 41s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 mvnsite 11m 56s the patch passed
+1 💚 javadoc 10m 57s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javadoc 9m 24s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 shadedclient 46m 57s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 13s hadoop-project in the patch passed.
+1 💚 unit 0m 13s hadoop-project-dist in the patch passed.
+1 💚 unit 0m 22s hadoop-minikdc in the patch passed.
+1 💚 unit 2m 48s hadoop-auth in the patch passed.
+1 💚 unit 0m 20s hadoop-nfs in the patch passed.
+1 💚 unit 2m 39s hadoop-kms in the patch passed.
+1 💚 unit 0m 50s hadoop-registry in the patch passed.
+1 💚 unit 3m 19s hadoop-hdfs-httpfs in the patch passed.
+1 💚 unit 2m 23s hadoop-hdfs-nfs in the patch passed.
-1 ❌ unit 209m 57s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch passed.
+1 💚 unit 110m 14s hadoop-mapreduce-client in the patch passed.
+1 💚 unit 0m 48s hadoop-mapreduce-examples in the patch passed.
+1 💚 unit 109m 32s hadoop-mapreduce-project in the patch passed.
+1 💚 unit 5m 18s hadoop-streaming in the patch passed.
+1 💚 unit 0m 50s hadoop-archive-logs in the patch passed.
+1 💚 unit 0m 38s hadoop-rumen in the patch passed.
+1 💚 unit 13m 3s hadoop-gridmix in the patch passed.
+1 💚 unit 0m 38s hadoop-datajoin in the patch passed.
-1 ❌ unit 0m 52s /patch-unit-hadoop-tools_hadoop-sls.txt hadoop-sls in the patch passed.
+1 💚 unit 0m 33s hadoop-fs2img in the patch passed.
+1 💚 unit 2m 25s hadoop-azure in the patch passed.
-1 ❌ unit 2m 15s /patch-unit-hadoop-tools_hadoop-aws.txt hadoop-aws in the patch passed.
+1 💚 unit 0m 31s hadoop-aliyun in the patch passed.
+1 💚 unit 0m 28s hadoop-benchmark in the patch passed.
+1 💚 unit 0m 30s hadoop-gcp in the patch passed.
+1 💚 unit 0m 29s hadoop-cos in the patch passed.
+1 💚 unit 0m 33s hadoop-huaweicloud in the patch passed.
+1 💚 unit 1m 14s hadoop-tos in the patch passed.
-1 ❌ asflicense 0m 44s /results-asflicense.txt The patch generated 1 ASF License warnings.
640m 12s
Reason Tests
Failed junit tests hadoop.yarn.server.router.webapp.TestRouterWebServicesREST
hadoop.yarn.server.router.subcluster.capacity.TestYarnFederationWithCapacityScheduler
hadoop.yarn.server.resourcemanager.TestRMHA
hadoop.yarn.sls.appmaster.TestAMSimulator
hadoop.fs.s3a.impl.streams.TestStreamFactories
hadoop.fs.s3a.TestS3AUnbuffer
Subsystem Report/Notes
Docker ClientAPI=1.52 ServerAPI=1.52 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/12/artifact/out/Dockerfile
GITHUB PR #8053
Optional Tests dupname asflicense codespell detsecrets xmllint compile javac javadoc mvninstall mvnsite unit shadedclient
uname Linux cfbc87d89ffd 5.15.0-156-generic #166-Ubuntu SMP Sat Aug 9 00:02:46 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / d2b2818
Default Java Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Multi-JDK versions /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/12/testReport/
Max. process+thread count 1964 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-project-dist hadoop-common-project/hadoop-minikdc hadoop-common-project/hadoop-auth hadoop-common-project/hadoop-nfs hadoop-common-project/hadoop-kms hadoop-common-project/hadoop-registry hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-hdfs-project/hadoop-hdfs-nfs hadoop-yarn-project/hadoop-yarn hadoop-mapreduce-project/hadoop-mapreduce-client hadoop-mapreduce-project/hadoop-mapreduce-examples hadoop-mapreduce-project hadoop-tools/hadoop-streaming hadoop-tools/hadoop-archive-logs hadoop-tools/hadoop-rumen hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-datajoin hadoop-tools/hadoop-sls hadoop-tools/hadoop-fs2img hadoop-tools/hadoop-azure hadoop-tools/hadoop-aws hadoop-tools/hadoop-aliyun hadoop-tools/hadoop-benchmark hadoop-tools/hadoop-gcp hadoop-cloud-storage-project/hadoop-cos hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-tos U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/12/console
versions git=2.25.1 maven=3.9.11
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@steveloughran
Copy link
Contributor

the license failures and s3a failures should all be fixed now: do a merge with trunk and non-forced update and yetus should be happy with hadoop-aws. No idea about the yarn/sls failures

@slfan1989
Copy link
Contributor

@zhtttylz We need to rebase this branch onto trunk; the ASF license issue has already been fixed in #8098.

@zhtttylz
Copy link
Contributor Author

zhtttylz commented Dec 8, 2025

@steveloughran @slfan1989 Thanks for the reminder. I’ve rebased HADOOP-19731 onto the latest trunk (with the ASF license fix from #8098) and pushed the updated branch so Yetus can rerun. Really appreciate your help here.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 21m 38s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
-1 ❌ test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+0 🆗 mvndep 9m 53s Maven dependency ordering for branch
+1 💚 mvninstall 35m 57s trunk passed
+1 💚 compile 18m 58s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 compile 19m 17s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 mvnsite 24m 23s trunk passed
-1 ❌ javadoc 0m 38s /branch-javadoc-hadoop-tools_hadoop-azure-jdkUbuntu-21.0.7+6-Ubuntu-0ubuntu120.04.txt hadoop-azure in trunk failed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04.
-1 ❌ javadoc 0m 35s /branch-javadoc-hadoop-tools_hadoop-azure-jdkUbuntu-17.0.15+6-Ubuntu-0ubuntu120.04.txt hadoop-azure in trunk failed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04.
+1 💚 shadedclient 176m 31s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 35s Maven dependency ordering for patch
+1 💚 mvninstall 23m 18s the patch passed
+1 💚 compile 18m 10s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javac 18m 10s the patch passed
+1 💚 compile 19m 18s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 javac 19m 18s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 mvnsite 24m 17s the patch passed
-1 ❌ javadoc 0m 37s /patch-javadoc-hadoop-tools_hadoop-azure-jdkUbuntu-21.0.7+6-Ubuntu-0ubuntu120.04.txt hadoop-azure in the patch failed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04.
-1 ❌ javadoc 0m 38s /patch-javadoc-hadoop-tools_hadoop-azure-jdkUbuntu-17.0.15+6-Ubuntu-0ubuntu120.04.txt hadoop-azure in the patch failed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04.
+1 💚 shadedclient 94m 15s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 0m 24s hadoop-project in the patch passed.
+1 💚 unit 0m 25s hadoop-project-dist in the patch passed.
+1 💚 unit 0m 35s hadoop-minikdc in the patch passed.
+1 💚 unit 3m 28s hadoop-auth in the patch passed.
+1 💚 unit 0m 33s hadoop-nfs in the patch passed.
+1 💚 unit 3m 16s hadoop-kms in the patch passed.
+1 💚 unit 1m 19s hadoop-registry in the patch passed.
+1 💚 unit 5m 0s hadoop-hdfs-httpfs in the patch passed.
+1 💚 unit 3m 22s hadoop-hdfs-nfs in the patch passed.
-1 ❌ unit 263m 57s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch passed.
+1 💚 unit 141m 33s hadoop-mapreduce-client in the patch passed.
+1 💚 unit 1m 27s hadoop-mapreduce-examples in the patch passed.
+1 💚 unit 140m 32s hadoop-mapreduce-project in the patch passed.
+1 💚 unit 7m 23s hadoop-streaming in the patch passed.
+1 💚 unit 1m 37s hadoop-archive-logs in the patch passed.
+1 💚 unit 1m 7s hadoop-rumen in the patch passed.
+1 💚 unit 21m 56s hadoop-gridmix in the patch passed.
+1 💚 unit 2m 16s hadoop-datajoin in the patch passed.
-1 ❌ unit 2m 57s /patch-unit-hadoop-tools_hadoop-sls.txt hadoop-sls in the patch passed.
+1 💚 unit 1m 43s hadoop-fs2img in the patch passed.
+1 💚 unit 4m 5s hadoop-azure in the patch passed.
+1 💚 unit 4m 8s hadoop-aws in the patch passed.
+1 💚 unit 1m 9s hadoop-aliyun in the patch passed.
+1 💚 unit 1m 6s hadoop-benchmark in the patch passed.
+1 💚 unit 1m 13s hadoop-gcp in the patch passed.
+1 💚 unit 1m 6s hadoop-cos in the patch passed.
+1 💚 unit 1m 4s hadoop-huaweicloud in the patch passed.
+1 💚 unit 2m 15s hadoop-tos in the patch passed.
+1 💚 asflicense 1m 41s The patch does not generate ASF License warnings.
980m 43s
Reason Tests
Failed junit tests hadoop.yarn.service.TestYarnNativeServices
hadoop.yarn.server.resourcemanager.TestRMHA
hadoop.yarn.server.router.subcluster.fair.TestYarnFederationWithFairScheduler
hadoop.yarn.sls.appmaster.TestAMSimulator
Subsystem Report/Notes
Docker ClientAPI=1.52 ServerAPI=1.52 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/13/artifact/out/Dockerfile
GITHUB PR #8053
Optional Tests dupname asflicense codespell detsecrets xmllint compile javac javadoc mvninstall mvnsite unit shadedclient
uname Linux cc4aa6a57dbe 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / a076fda
Default Java Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Multi-JDK versions /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/13/testReport/
Max. process+thread count 1784 (vs. ulimit of 5500)
modules C: hadoop-project hadoop-project-dist hadoop-common-project/hadoop-minikdc hadoop-common-project/hadoop-auth hadoop-common-project/hadoop-nfs hadoop-common-project/hadoop-kms hadoop-common-project/hadoop-registry hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-hdfs-project/hadoop-hdfs-nfs hadoop-yarn-project/hadoop-yarn hadoop-mapreduce-project/hadoop-mapreduce-client hadoop-mapreduce-project/hadoop-mapreduce-examples hadoop-mapreduce-project hadoop-tools/hadoop-streaming hadoop-tools/hadoop-archive-logs hadoop-tools/hadoop-rumen hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-datajoin hadoop-tools/hadoop-sls hadoop-tools/hadoop-fs2img hadoop-tools/hadoop-azure hadoop-tools/hadoop-aws hadoop-tools/hadoop-aliyun hadoop-tools/hadoop-benchmark hadoop-tools/hadoop-gcp hadoop-cloud-storage-project/hadoop-cos hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-tos U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8053/13/console
versions git=2.25.1 maven=3.9.11
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@slfan1989
Copy link
Contributor

@zhtttylz I’m going to merge this PR, as the JavaDoc error is unrelated to these changes. Many thanks to @steveloughran and @szetszwo for reviewing the code.

@slfan1989 slfan1989 merged commit 2fcbc69 into apache:trunk Dec 9, 2025
1 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants