Skip to content

Migrate tests to Gitlab #8656

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 111 commits into
base: master
Choose a base branch
from
Draft

Migrate tests to Gitlab #8656

wants to merge 111 commits into from
+960 −433

Conversation

randomanderson
Copy link
Contributor

@randomanderson randomanderson commented Apr 1, 2025 •
edited
Loading

What Does This Do

Runs the test suite in Gitlab.

The main bulk of the changes are in .gitlab-ci.yml which creates the test jobs, applies the appropriate caches, uploads the results to Datadog CI Observability, saves artifacts, etc

Changes to tests

  • Using specific container versions because they need to be mirrored
  • Replacing many instances where localhost was assumed

Motivation

Additional Notes

Further work needs to be done on "right-sizing" the test jobs. There are multiple knobs to tweak between:

  • total memory
  • CPU cores
  • Gradle workers
  • Gradle memory per work
  • Number of parallel jobs
    where there is an optimization between job runtime, number of jobs, size of cache, "stability".

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@randomanderson
first pass checks
10ecbb9
@randomanderson
add some debug
26a7adb
@randomanderson
Revert "add some debug"
f8448c9 
This reverts commit 26a7adb.
@randomanderson
Normalize node index and node total
0b8643a
@randomanderson
fix normalization
65d41ac
@randomanderson
actually use the normalized values
661749d
@randomanderson
Merge remote-tracking branch 'origin/master' into landerson/gitlab-ch…
7e21e7b 
…ecks-migration
@randomanderson
first pass: migrate tests to Gitlab
70c494d
@randomanderson
Merge branch 'master' into landerson/migrate-tests
f3ca3e1 
# Conflicts:
#	.gitlab-ci.yml
@randomanderson
less scenarios for now
2ae3cf3
@randomanderson
bump memory and workers
c3ebdc0
@randomanderson
actually use task partitions
2d78199
@randomanderson
Add section start/end
aba4f20
@randomanderson
Allow individual tests to control gradle memory
87bffbf
@randomanderson
remove a little of the reportspam
6b6d4e5
@randomanderson
use concrete docker image tags
b2340e0
@randomanderson
configure test containers to use mirror
42784ee
@randomanderson
Merge remote-tracking branch 'origin/master' into landerson/migrate-t…
3bed067 
…ests
@randomanderson
fix limit
e781c3b
@randomanderson
fix missing container versions
ffb90db
@randomanderson
Better gitlab naming with smarter split
c18b491
@randomanderson
update caches with test dep cache, save test results
a09c626
@randomanderson
Cleanup repositories {} blocks
97d5bc6
@randomanderson
update proxy url to use internal routing
2b37e3b
@randomanderson
no "s"
7092cd0
@randomanderson
allow insecure everywhere
391d0c3
@randomanderson
include apache with confluence
e225757
@randomanderson
Merge branch 'landerson/replace-maven-central' into landerson/migrate…
340aaa1 
…-tests

# Conflicts:
#	dd-java-agent/instrumentation/kafka-clients-3.8/src/test/groovy/KafkaClientCustomPropagationConfigTest.groovy
#	dd-java-agent/instrumentation/kafka-clients-3.8/src/test/groovy/KafkaClientTestBase.groovy
@randomanderson
remove intentional fail
7019854
@randomanderson
use gradlePluginCache, mavenCentral after pluginportal
08a85b0
@randomanderson
remove intentionally failing test
3631181
@randomanderson
Merge remote-tracking branch 'origin/master' into landerson/migrate-t…
9f51ad4 
…ests
@randomanderson
use a test UDP server to record oom events
0975adc
@randomanderson
Make crash tracking smoke test more resiliant
561f192
@randomanderson
loop through messages until the correct event
551f88e
@randomanderson
some debug
3df5bbf
@randomanderson
configurable dogstatsd port
e4b8c9e
@randomanderson
enable everything
8794264
@randomanderson
Merge branch 'landerson/dd-dogstatsd-port' into landerson/fix-crashtr…
b5a1003 
…ackingsmoke
@randomanderson
use sleep instead of park nanos
d6250d5
@randomanderson
save body data ahead of time
0ecc8bb
@randomanderson
retry once for system failures
38a35ad
@randomanderson
spotless
2e0d7ba
@randomanderson
cleanup
ac863f0
@randomanderson
Merge remote-tracking branch 'origin/master' into landerson/fix-crash…
0383ef9 
…trackingsmoke
@randomanderson
Merge branch 'landerson/fix-crashtrackingsmoke' into landerson/migrat…
b378de5 
…e-tests

# Conflicts:
#	dd-smoke-tests/crashtracking/src/test/java/datadog/smoketest/CrashtrackingSmokeTest.java
#	dd-smoke-tests/crashtracking/src/test/java/datadog/smoketest/TestUDPServer.java
#	dd-smoke-tests/src/main/java/datadog/smoketest/OutputThreads.java
@randomanderson
spotless/merge issues
da9a29c
@randomanderson
Skip ExceptionHistogramTest on J9
0f26adf
@randomanderson
add a print statement around the body for debugging
edeebc2
@randomanderson
comment out all but 8, 17, and 21 for now
078a3c7
@randomanderson
fix spring 6 forwarding headers
a546529
@randomanderson
revert logging statements
f16a6af
@randomanderson
needs to be set in 3.1 for latestDepTest
a1e0bb1
@randomanderson
faster OOM
3f62a18
@randomanderson
property was set in incorrect location
014057c
@randomanderson
ssi_smoke, flaky, and esoteric jvms on master only
3c28009
@randomanderson
use normal runner when TestContainers isn't needed
5c2c161
@randomanderson
skip forwarding header filter here too
67a45fe
@randomanderson
tweaks
96cfd44
@randomanderson randomanderson force-pushed the landerson/migrate-tests branch from 862cc6c to 96cfd44 Compare April 16, 2025 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
comp: tooling Build & Tooling
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@randomanderson @smola