Commit 45a5f88
authored
Use ci-perf-kit 0.8.6 (new epoch for CI runner package update on 5th Jan) (#1444)
We observed a performance slowdown in CI results recently. The slowdown
first appears in the 6th Jan CI run (before the Rust version upgrade
which was on 12th Jan): the canary showed a ~3% regression on luindex,
and openjdk-stickyimmix showed a similar slowdown. (Other benchmarks
also show regressions; luindex is used here as the performance
difference for luindex is most obvious)
I also tested 3 builds
([`20251215`](2ad6d36),
[`20260106`](473fd58),
and
[`20260112`](e30d0a0))
with luindex (on a Zen 3 machine, rather than CI runenr's Zen 2), there
was no measurable perf difference between those 3 builds.
[link](https://squirrel.anu.edu.au/plotty/yilin/mmtk/#0|bear-2026-01-15-Thu-042440&benchmark^build^invocation^iteration&bmtime&|10&iteration^1^1|20&1^invocation|30&1&benchmark&build;jdk-mmtk-251215|41&Histogram%20(with%20CI)^build^benchmark&)
<img width="2179" height="940" alt="ScreenShot_2026-01-15_181157_830"
src="https://github.com/user-attachments/assets/3320418e-9033-47c0-8a70-b2e6f2dbfccd"
/>
@no-defun-allowed confirmed that there was a big update of all the
packages for CI runners on 5th Jan. We started to see the difference on
the commit in 6th Jan. So the performance difference is unrelated with
MMTk moving to Rust 1.92 (which happened on 12th Jan).
This PR updates `ci-perf-kit` to 0.8.6 which will plot 5th Jan as a new
epoch.1 parent 56adff4 commit 45a5f88
File tree
4 files changed
+8
-8
lines changed- .github/workflows
4 files changed
+8
-8
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
69 | 69 | | |
70 | 70 | | |
71 | 71 | | |
72 | | - | |
| 72 | + | |
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
45 | | - | |
| 45 | + | |
46 | 46 | | |
47 | 47 | | |
48 | 48 | | |
| |||
94 | 94 | | |
95 | 95 | | |
96 | 96 | | |
97 | | - | |
| 97 | + | |
98 | 98 | | |
99 | 99 | | |
100 | 100 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
112 | 112 | | |
113 | 113 | | |
114 | 114 | | |
115 | | - | |
| 115 | + | |
116 | 116 | | |
117 | 117 | | |
118 | 118 | | |
| |||
223 | 223 | | |
224 | 224 | | |
225 | 225 | | |
226 | | - | |
| 226 | + | |
227 | 227 | | |
228 | 228 | | |
229 | 229 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
48 | | - | |
| 48 | + | |
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
| |||
142 | 142 | | |
143 | 143 | | |
144 | 144 | | |
145 | | - | |
| 145 | + | |
146 | 146 | | |
147 | 147 | | |
148 | 148 | | |
| |||
233 | 233 | | |
234 | 234 | | |
235 | 235 | | |
236 | | - | |
| 236 | + | |
237 | 237 | | |
238 | 238 | | |
239 | 239 | | |
| |||
0 commit comments