Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#1628] test(client): Fix double release ShuffleIndexResult cause exception to pass flaky test #2179

Merged
merged 3 commits into from
Oct 18, 2024

Conversation

maobaolong
Copy link
Member

@maobaolong maobaolong commented Oct 14, 2024

What changes were proposed in this pull request?

(Please outline the changes and how this PR fixes the issue.)

Why are the changes needed?

  • Pass the flaky test
  • Avoid memory leak after double release the ShuffleIndexResult

Fix: #1628

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Flaky test can be fixed.

@maobaolong maobaolong changed the title [#2178] test(client): Fix Fix double release ShuffleIndexResult cause exception to pass flaky test [#2178] test(client): Fix double release ShuffleIndexResult cause exception to pass flaky test Oct 14, 2024
Copy link

github-actions bot commented Oct 14, 2024

Test Results

 2 926 files  +21   2 926 suites  +21   5h 57m 12s ⏱️ + 9m 19s
 1 041 tests ± 0   1 039 ✅ + 1   2 💤 ±0  0 ❌  - 1 
13 003 runs  +50  12 973 ✅ +51  30 💤 ±0  0 ❌  - 1 

Results for commit 361afac. ± Comparison against base commit a08c227.

♻️ This comment has been updated with latest results.

@maobaolong
Copy link
Member Author

Encountered flaky test.

Error:  Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 228.685 s <<< FAILURE! - in org.apache.uniffle.test.QuorumTest
Error:  case10  Time elapsed: 184.21 s  <<< FAILURE!
org.opentest4j.AssertionFailedError: expected: <true> but was: <false>
	at org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:55)
	at org.junit.jupiter.api.AssertTrue.assertTrue(AssertTrue.java:40)
	at org.junit.jupiter.api.AssertTrue.assertTrue(AssertTrue.java:35)
	at org.junit.jupiter.api.Assertions.assertTrue(Assertions.java:179)
	at org.apache.uniffle.test.QuorumTest.case10(QuorumTest.java:948)

try {
this.buffer.release();
} catch (Throwable e) {
LOG.warn(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you log the Throwable e, too?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You should catch specific exception class instead of Throwable.

@maobaolong
Copy link
Member Author

@jerqi Log the e too, PTAL.

@maobaolong maobaolong changed the title [#2178] test(client): Fix double release ShuffleIndexResult cause exception to pass flaky test [#1628] test(client): Fix double release ShuffleIndexResult cause exception to pass flaky test Oct 15, 2024
@maobaolong maobaolong requested a review from jerqi October 18, 2024 01:29
Copy link
Contributor

@jerqi jerqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@jerqi jerqi merged commit 4c14b97 into apache:master Oct 18, 2024
43 checks passed
@maobaolong
Copy link
Member Author

@jerqi Thanks for your review!

maobaolong added a commit to maobaolong/incubator-uniffle that referenced this pull request Nov 4, 2024
…se exception to pass flaky test (apache#2179)

### What changes were proposed in this pull request?

(Please outline the changes and how this PR fixes the issue.)

### Why are the changes needed?

- Pass the flaky test
- Avoid memory leak after double release the `ShuffleIndexResult`

Fix: apache#1628

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Flaky test can be fixed.

(cherry picked from commit 4c14b97)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] Occasionally encountering IllegalReferenceCountException when releasing ShuffleIndexResult
2 participants