Skip to content

Commit 45a5f88

Browse files
authored
Use ci-perf-kit 0.8.6 (new epoch for CI runner package update on 5th Jan) (#1444)
We observed a performance slowdown in CI results recently. The slowdown first appears in the 6th Jan CI run (before the Rust version upgrade which was on 12th Jan): the canary showed a ~3% regression on luindex, and openjdk-stickyimmix showed a similar slowdown. (Other benchmarks also show regressions; luindex is used here as the performance difference for luindex is most obvious) I also tested 3 builds ([`20251215`](2ad6d36), [`20260106`](473fd58), and [`20260112`](e30d0a0)) with luindex (on a Zen 3 machine, rather than CI runenr's Zen 2), there was no measurable perf difference between those 3 builds. [link](https://squirrel.anu.edu.au/plotty/yilin/mmtk/#0|bear-2026-01-15-Thu-042440&benchmark^build^invocation^iteration&bmtime&|10&iteration^1^1|20&1^invocation|30&1&benchmark&build;jdk-mmtk-251215|41&Histogram%20(with%20CI)^build^benchmark&) <img width="2179" height="940" alt="ScreenShot_2026-01-15_181157_830" src="https://github.com/user-attachments/assets/3320418e-9033-47c0-8a70-b2e6f2dbfccd" /> @no-defun-allowed confirmed that there was a big update of all the packages for CI runners on 5th Jan. We started to see the difference on the commit in 6th Jan. So the performance difference is unrelated with MMTk moving to Rust 1.92 (which happened on 12th Jan). This PR updates `ci-perf-kit` to 0.8.6 which will plot 5th Jan as a new epoch.
1 parent 56adff4 commit 45a5f88

File tree

4 files changed

+8
-8
lines changed

4 files changed

+8
-8
lines changed

.github/workflows/micro-bm.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ jobs:
6969
with:
7070
repository: mmtk/ci-perf-kit
7171
token: ${{ secrets.GITHUB_TOKEN }}
72-
ref: "0.8.5"
72+
ref: "0.8.6"
7373
path: ci-perf-kit
7474
submodules: true
7575
# Use rust-toolchain in the trunk (it doesnt matter much - if the toolchains defined in the trunk and the branch are different, we cant run anyway)

.github/workflows/perf-baseline.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ jobs:
4242
with:
4343
token: ${{ secrets.CI_ACCESS_TOKEN }}
4444
repository: mmtk/ci-perf-kit
45-
ref: "0.8.5"
45+
ref: "0.8.6"
4646
path: ci-perf-kit
4747
submodules: true
4848
# setup
@@ -94,7 +94,7 @@ jobs:
9494
with:
9595
token: ${{ secrets.CI_ACCESS_TOKEN }}
9696
repository: mmtk/ci-perf-kit
97-
ref: "0.8.5"
97+
ref: "0.8.6"
9898
path: ci-perf-kit
9999
submodules: true
100100
# setup

.github/workflows/perf-compare-ci.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -112,7 +112,7 @@ jobs:
112112
with:
113113
repository: mmtk/ci-perf-kit
114114
token: ${{ secrets.CI_ACCESS_TOKEN }}
115-
ref: "0.8.5"
115+
ref: "0.8.6"
116116
path: ci-perf-kit
117117
submodules: true
118118
# setup
@@ -223,7 +223,7 @@ jobs:
223223
with:
224224
repository: mmtk/ci-perf-kit
225225
token: ${{ secrets.CI_ACCESS_TOKEN }}
226-
ref: "0.8.5"
226+
ref: "0.8.6"
227227
path: ci-perf-kit
228228
submodules: true
229229
# setup

.github/workflows/perf-regression-ci.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ jobs:
4545
uses: actions/checkout@v4
4646
with:
4747
repository: mmtk/ci-perf-kit
48-
ref: "0.8.5"
48+
ref: "0.8.6"
4949
path: ci-perf-kit
5050
token: ${{ secrets.CI_ACCESS_TOKEN }}
5151
submodules: true
@@ -142,7 +142,7 @@ jobs:
142142
uses: actions/checkout@v4
143143
with:
144144
repository: mmtk/ci-perf-kit
145-
ref: "0.8.5"
145+
ref: "0.8.6"
146146
path: ci-perf-kit
147147
submodules: true
148148
# download canary build
@@ -233,7 +233,7 @@ jobs:
233233
uses: actions/checkout@v4
234234
with:
235235
repository: mmtk/ci-perf-kit
236-
ref: "0.8.5"
236+
ref: "0.8.6"
237237
path: ci-perf-kit
238238
token: ${{ secrets.CI_ACCESS_TOKEN }}
239239
submodules: true

0 commit comments

Comments
 (0)