Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MINOR] improve(server): Log more before server remove resource #2133

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

maobaolong
Copy link
Member

@maobaolong maobaolong commented Sep 21, 2024

What changes were proposed in this pull request?

Log more before server remove resource

Why are the changes needed?

Clearly and easily to view the job partitons blocks info, help to find the biggest partition.

Does this PR introduce any user-facing change?

(Please list the user-facing changes introduced by your change, including

  1. Change in user-facing APIs.
  2. Addition or removal of property keys.)

No.

How was this patch tested?

[2024-09-20 23:31:36.211] [clearResourceThread] [INFO] ShuffleTaskManager - Remove app info: appId: app-20240920233127-0046_1726846285810 shuffleId: 0 contains partition/block: 3/19
The maxSizePartitionInfo: [id=1, shuffleId=0, size=624, blockCount=16]
[2024-09-21 11:06:40.011] [clearResourceThread] [INFO] ShuffleTaskManager - Remove app info: appId: application_1703049085550_21177982_1726887839406 
 shuffleId: 0 contains partition/block: 1/193
 shuffleId: 2 contains partition/block: 1/4
The maxSizePartitionInfo: [id=0, shuffleId=0, size=707108250, blockCount=193]

[2024-09-21 11:06:39.979] [clearResourceThread] [INFO] ShuffleTaskManager - Remove app info: appId: application_1703049085550_21177982_1726887839406
 shuffleId: 0 contains partition/block: 1/51
 shuffleId: 1 contains partition/block: 1/8
The maxSizePartitionInfo: [id=0, shuffleId=0, size=162936203, blockCount=51]

@maobaolong maobaolong changed the title [MINOR] Log more before server remove resource [MINOR] improve(server): Log more before server remove resource Sep 21, 2024
Copy link

github-actions bot commented Sep 21, 2024

Test Results

 2 882 files  +1   2 882 suites  +1   5h 55m 39s ⏱️ -29s
 1 019 tests ±0   1 018 ✅ +1   1 💤 ±0  0 ❌  - 1 
12 868 runs  +1  12 853 ✅ +2  15 💤 ±0  0 ❌  - 1 

Results for commit 7f2cdb6. ± Comparison against base commit 49225d8.

♻️ This comment has been updated with latest results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant