-
Notifications
You must be signed in to change notification settings - Fork 1.6k
KEP-5620: Node resizing via balloons. #5624
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
bwsalmon
commented
Oct 6, 2025
- One-line PR description: Node resizing via balloons
- Issue link: Node resizing via balloons #5620
- Other comments:
Hi @bwsalmon. Thanks for your PR. I'm waiting for a kubernetes member to verify that this patch is reasonable to test. If it is, they should reply with Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
#### Multiple Kubelets per node for testing | ||
|
||
A user who is testing some Kubernetes feature would like to run many Kubelets on the same host to decrease the amount of resources needed to test scenarios with large numbers of Kubelets. By enabling balloons and then resizing the balloons to ensure each Kubelet only consumes one Nth of the host, the customer can place N Kubelets on the same host without overloading the host itself. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This usecase seems to be better served by #5319
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let me take a look. Obviously there are a few ways to address the use case.
/ok-to-test please make sure to fill |
Consider including folks who also work outside the SIG or subproject. | ||
--> | ||
|
||
## Design Details |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- Does this mean that the Balloon Pods are DaemonSets that specify the new PriorityClass introduced in this KEP? In other words, this doesn’t involve adding a new core resource like BalloonPod, right?
- Since they are expected to run in the kube-system namespace, is that achieved by restricting the new PriorityClass so that it can only be used within the kube-system namespace?
- Since they’re treated like regular pods, that means Balloon Pods are actually launched as containers (e.g. containers that just keep sleeping indefinitely), right?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Excellent questions:
- Yes, I don't believe we need to add a custom resource, although if we find a need I'm open to be convinced otherwise. The hope is for this to be very light weight.
- I think that is reasonable, yes. I don't have enough clarity on the expectations of ACLs to feel confident about that yet, though.
- Yes, that is correct; they should be normal containers that do nothing.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks! It's much clearer now.
Yes, I don't believe we need to add a custom resource
It might be better to specify in the Non-Goals section that new core and custom resources should not be added. Also, you could include a sample manifest of how to use Balloon Pods in the Proposal section or somewhere, such as a DaemonSet with a new priority class.
Sg, thanks! I'll fill in the PRR yaml. This should be fine for 1.36, unless @dchen1107 has a different opinion than our last conversation... |
a80d3a4
to
5746db2
Compare
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: bwsalmon The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |