-
Notifications
You must be signed in to change notification settings - Fork 855
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve time and space efficiency of backend Docker container build #3006
Comments
Also likely related: #2982 |
@GregSutcliffe will have some thoughts on this. I know he has mentioned some things around go and that there might be a significantly more efficient way to get the git info without needed a full clone |
Im refactoring the docker container into a more builder pattern style (with separate containers for golang and rust) Are there any dependencies relying on rust right now? because I dont see any |
@MoralCode |
It seems like that has since been removed/replaced with a tarball method of installing firefox and geckodriver 9eb4b61 |
@sgoggins do you know of any rust dependencies? |
Is your feature request related to a problem? If so, please describe the problem:
disk space limitations make it hard to build the backend docker image (seems to be at LEAST 6GB before it failed on my fedora VM, possibly 12 if podman needs 2x the space to write the final image)
Potential solutions:
After looking through the dockerfiles I noticed a few things that could be improved
install-workers-deps.sh
includes the NLTKpopular
metapackage, which includes lots of other packages. are all of these sub packages being used? (theres between 8k and 139M savings depending on what can be excluded, i have a list of them by size in my notes)My remaining questions so far:
Additional context:
Slack thread (in CHAOSS Slack) about this: https://chaoss-workspace.slack.com/archives/C0226ELG6R4/p1739815260328199
This PR seems to at least have been attempting a partial solution for the first two parts of this by creating a separate build step: #2947
The large image size may also cause an issue for some users who are using older versions of podman which may have trouble making large commits containing large image layers
The text was updated successfully, but these errors were encountered: