ci: add microbench SLO change detection, fix bench interruptible policy #15417

igoragoli · 2025-11-25T13:49:53Z

Description

Adds missing workflow: auto_cancel: on_new_commit: interruptible configuration to micro/macrobenchmarks child pipelines. Without this, jobs are not really interruptible.
Adds a comment explaining why we use when: on_success for this microbenchmark, relates to ci: update benchmark slo + reporting dependencies #15339 (review).
Adds the check-slo-breaches template from benchmarking-platform-tools and add SLO change detection.
(Less importantly, removes the check-slo-breaches image pin, which was being used for testing an update to the SLO check logic).

Testing

Testing change 1:

Attempt to interrupt without workflow configuration.
- ❌ Microbenchmarks ran until the end despite a pipeline being triggered, undesired behavior.
- ✅ SLO checks were skipped (see "Microbenchmarks" link above), desired behavior, since we have when: on_success for these.
Attempt to interrupt after adding workflow configuration.
- ✅ Microbenchmarks were interrupted, desired behavior.
- ✅ SLO checks were also skipped, desired behavior.

Testing change 3:

SLO change detection metric on Datadog, sent by this CI job.

Risks

None.

Additional Notes

github-actions · 2025-11-25T13:50:28Z

CODEOWNERS have been resolved as:

.gitlab/benchmarks/macrobenchmarks.yml                                  @DataDog/python-guild @DataDog/apm-core-python
.gitlab/benchmarks/microbenchmarks.yml                                  @DataDog/python-guild @DataDog/apm-core-python

github-actions · 2025-11-25T14:17:45Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 212 ± 3 ms.

The average import time from base is: 214 ± 2 ms.

The import time difference between this PR and base is: -2.4 ± 0.1 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.115 ms (1.00%)

ddtrace.bootstrap.sitecustomize 1.079 ms (0.51%)

ddtrace.bootstrap.preload 1.079 ms (0.51%)

ddtrace.internal.remoteconfig.client 0.536 ms (0.25%)

ddtrace 1.036 ms (0.49%)

ddtrace._logger 0.488 ms (0.23%)

ddtrace.internal.telemetry 0.488 ms (0.23%)

ddtrace.internal.telemetry.writer 0.488 ms (0.23%)

ddtrace.internal.utils.version 0.488 ms (0.23%)

ddtrace.version 0.488 ms (0.23%)

ddtrace.internal._unpatched 0.087 ms (0.04%)

subprocess 0.051 ms (0.02%)

contextlib 0.051 ms (0.02%)

json 0.036 ms (0.02%)

json.decoder 0.036 ms (0.02%)

re 0.036 ms (0.02%)

enum 0.036 ms (0.02%)

types 0.036 ms (0.02%)

pr-commenter · 2025-11-26T09:54:25Z

Performance SLOs

Comparing candidate augusto/apmsp-2373.update-slo-check (b5f4e6e) with baseline main (47afaf0)

📈 Performance Regressions (3 suites)

📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.403µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.3%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.7%

✅ add_inplace_aspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.5%

Memory: ✅ 40.482MB (SLO: <41.500MB -2.5%) vs baseline: +5.8%

✅ add_inplace_noaspect

Time: ✅ 0.322µs (SLO: <10.000µs 📉 -96.8%) vs baseline: -0.8%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.3%

✅ add_noaspect

Time: ✅ 0.280µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.3%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +5.1%

✅ bytearray_aspect

Time: ✅ 1.349µs (SLO: <10.000µs 📉 -86.5%) vs baseline: ~same

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%

✅ bytearray_extend_aspect

Time: ✅ 1.505µs (SLO: <10.000µs 📉 -85.0%) vs baseline: -0.2%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.6%

✅ bytearray_extend_noaspect

Time: ✅ 0.615µs (SLO: <10.000µs 📉 -93.9%) vs baseline: +0.5%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +5.1%

✅ bytearray_noaspect

Time: ✅ 0.482µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +0.6%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.8%

✅ bytes_aspect

Time: ✅ 1.289µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -0.2%

Memory: ✅ 40.344MB (SLO: <41.500MB -2.8%) vs baseline: +5.5%

✅ bytes_noaspect

Time: ✅ 0.498µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.6%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%

✅ bytesio_aspect

Time: ✅ 1.342µs (SLO: <10.000µs 📉 -86.6%) vs baseline: +2.6%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.5%

✅ bytesio_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.6%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +5.0%

✅ capitalize_aspect

Time: ✅ 0.732µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -1.5%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +3.9%

✅ capitalize_noaspect

Time: ✅ 0.438µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +0.7%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.2%

✅ casefold_aspect

Time: ✅ 0.743µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +1.2%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.5%

✅ casefold_noaspect

Time: ✅ 0.373µs (SLO: <10.000µs 📉 -96.3%) vs baseline: ~same

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +4.7%

✅ decode_aspect

Time: ✅ 0.726µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.3%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.1%

✅ decode_noaspect

Time: ✅ 0.418µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.1%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.5%

✅ encode_aspect

Time: ✅ 0.712µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.3%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +3.9%

✅ encode_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +1.1%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +5.0%

✅ format_aspect

Time: ✅ 3.434µs (SLO: <10.000µs 📉 -65.7%) vs baseline: +0.1%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.1%

✅ format_map_aspect

Time: ✅ 3.574µs (SLO: <10.000µs 📉 -64.3%) vs baseline: -0.8%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.4%

✅ format_map_noaspect

Time: ✅ 0.768µs (SLO: <10.000µs 📉 -92.3%) vs baseline: -0.1%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.7%

✅ format_noaspect

Time: ✅ 0.593µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.9%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +5.0%

✅ index_aspect

Time: ✅ 0.359µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +1.2%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%

✅ index_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -1.8%

Memory: ✅ 40.088MB (SLO: <41.500MB -3.4%) vs baseline: +4.7%

✅ join_aspect

Time: ✅ 1.346µs (SLO: <10.000µs 📉 -86.5%) vs baseline: +1.2%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.1%

✅ join_noaspect

Time: ✅ 0.492µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.3%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%

✅ ljust_aspect

Time: ✅ 2.611µs (SLO: <20.000µs 📉 -86.9%) vs baseline: +0.5%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +5.0%

✅ ljust_noaspect

Time: ✅ 0.405µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.3%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%

✅ lower_aspect

Time: ✅ 2.289µs (SLO: <10.000µs 📉 -77.1%) vs baseline: +2.8%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +4.7%

✅ lower_noaspect

Time: ✅ 0.368µs (SLO: <10.000µs 📉 -96.3%) vs baseline: ~same

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +5.3%

✅ lstrip_aspect

Time: ✅ 2.239µs (SLO: <20.000µs 📉 -88.8%) vs baseline: -0.8%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.7%

✅ lstrip_noaspect

Time: ✅ 0.378µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.3%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.6%

✅ modulo_aspect

Time: ✅ 1.045µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +4.4%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +3.8%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.553µs (SLO: <10.000µs 📉 -84.5%) vs baseline: -0.2%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.7%

✅ modulo_aspect_for_bytes

Time: ✅ 0.980µs (SLO: <10.000µs 📉 -90.2%) vs baseline: +0.2%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.6%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.232µs (SLO: <10.000µs 📉 -87.7%) vs baseline: +0.8%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.9%

✅ modulo_noaspect

Time: ✅ 0.627µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.6%

Memory: ✅ 40.069MB (SLO: <41.500MB -3.4%) vs baseline: +4.3%

✅ replace_aspect

Time: ✅ 4.847µs (SLO: <10.000µs 📉 -51.5%) vs baseline: -2.0%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.6%

✅ replace_noaspect

Time: ✅ 0.458µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -1.0%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%

✅ repr_aspect

Time: ✅ 0.902µs (SLO: <10.000µs 📉 -91.0%) vs baseline: -1.0%

Memory: ✅ 40.383MB (SLO: <41.500MB -2.7%) vs baseline: +5.5%

✅ repr_noaspect

Time: ✅ 0.419µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.5%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%

✅ rstrip_aspect

Time: ✅ 1.948µs (SLO: <20.000µs 📉 -90.3%) vs baseline: +1.3%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +5.1%

✅ rstrip_noaspect

Time: ✅ 0.377µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.4%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +5.2%

✅ slice_aspect

Time: ✅ 0.492µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.3%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +5.0%

✅ slice_noaspect

Time: ✅ 0.445µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -1.8%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.9%

✅ stringio_aspect

Time: ✅ 1.537µs (SLO: <10.000µs 📉 -84.6%) vs baseline: -0.9%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.9%

✅ stringio_noaspect

Time: ✅ 0.710µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.8%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +5.1%

✅ strip_aspect

Time: ✅ 2.241µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +1.4%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.3%

✅ strip_noaspect

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.2%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%

✅ swapcase_aspect

Time: ✅ 2.757µs (SLO: <10.000µs 📉 -72.4%) vs baseline: 📈 +12.7%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +5.0%

✅ swapcase_noaspect

Time: ✅ 0.543µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.9%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.9%

✅ title_aspect

Time: ✅ 2.441µs (SLO: <10.000µs 📉 -75.6%) vs baseline: +2.1%

Memory: ✅ 40.049MB (SLO: <41.500MB -3.5%) vs baseline: +4.7%

✅ title_noaspect

Time: ✅ 0.500µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.6%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%

✅ translate_aspect

Time: ✅ 3.301µs (SLO: <10.000µs 📉 -67.0%) vs baseline: +0.2%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%

✅ translate_noaspect

Time: ✅ 1.040µs (SLO: <10.000µs 📉 -89.6%) vs baseline: ~same

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%

✅ upper_aspect

Time: ✅ 2.299µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +3.5%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +5.0%

✅ upper_noaspect

Time: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.6%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.3%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.201µs (SLO: <10.000µs 📉 -48.0%) vs baseline: 📈 +26.0%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.7%

✅ ospathbasename_noaspect

Time: ✅ 1.092µs (SLO: <10.000µs 📉 -89.1%) vs baseline: +0.3%

Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.1%

✅ ospathjoin_aspect

Time: ✅ 6.125µs (SLO: <10.000µs 📉 -38.7%) vs baseline: -0.4%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.2%

✅ ospathjoin_noaspect

Time: ✅ 2.292µs (SLO: <10.000µs 📉 -77.1%) vs baseline: +0.4%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +3.9%

✅ ospathnormcase_aspect

Time: ✅ 3.436µs (SLO: <10.000µs 📉 -65.6%) vs baseline: -0.3%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.9%

✅ ospathnormcase_noaspect

Time: ✅ 0.575µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.4%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.8%

✅ ospathsplit_aspect

Time: ✅ 4.742µs (SLO: <10.000µs 📉 -52.6%) vs baseline: -0.7%

Memory: ✅ 40.305MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.0%

✅ ospathsplit_noaspect

Time: ✅ 1.591µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.2%

Memory: ✅ 40.403MB (SLO: <41.000MB 🟡 -1.5%) vs baseline: +4.6%

✅ ospathsplitdrive_aspect

Time: ✅ 3.706µs (SLO: <10.000µs 📉 -62.9%) vs baseline: +1.9%

Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +4.9%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.701µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.7%

Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.0%

✅ ospathsplitext_aspect

Time: ✅ 4.484µs (SLO: <10.000µs 📉 -55.2%) vs baseline: -0.5%

Memory: ✅ 40.305MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.2%

✅ ospathsplitext_noaspect

Time: ✅ 1.397µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +1.0%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.7%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.411µs (SLO: <20.000µs 📉 -82.9%) vs baseline: 📈 +15.8%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

✅ 1-count-metrics-100-times

Time: ✅ 200.637µs (SLO: <220.000µs -8.8%) vs baseline: -0.6%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%

✅ 1-distribution-metric-1-times

Time: ✅ 3.286µs (SLO: <20.000µs 📉 -83.6%) vs baseline: -0.2%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.8%

✅ 1-distribution-metrics-100-times

Time: ✅ 215.919µs (SLO: <230.000µs -6.1%) vs baseline: -0.8%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

✅ 1-gauge-metric-1-times

Time: ✅ 2.187µs (SLO: <20.000µs 📉 -89.1%) vs baseline: +0.1%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%

✅ 1-gauge-metrics-100-times

Time: ✅ 135.991µs (SLO: <150.000µs -9.3%) vs baseline: -0.2%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ 1-rate-metric-1-times

Time: ✅ 3.079µs (SLO: <20.000µs 📉 -84.6%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.2%

✅ 1-rate-metrics-100-times

Time: ✅ 214.645µs (SLO: <250.000µs 📉 -14.1%) vs baseline: -0.4%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ 100-count-metrics-100-times

Time: ✅ 20.396ms (SLO: <22.000ms -7.3%) vs baseline: -0.5%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.270ms (SLO: <2.300ms 🟡 -1.3%) vs baseline: ~same

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.415ms (SLO: <1.550ms -8.7%) vs baseline: +0.4%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

✅ 100-rate-metrics-100-times

Time: ✅ 2.212ms (SLO: <2.550ms 📉 -13.3%) vs baseline: -0.8%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.2%

✅ flush-1-metric

Time: ✅ 4.603µs (SLO: <20.000µs 📉 -77.0%) vs baseline: ~same

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

✅ flush-100-metrics

Time: ✅ 175.405µs (SLO: <250.000µs 📉 -29.8%) vs baseline: +0.9%

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.9%

✅ flush-1000-metrics

Time: ✅ 2.180ms (SLO: <2.500ms 📉 -12.8%) vs baseline: -0.4%

Memory: ✅ 35.940MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.9%

🟡 Near SLO Breach (16 suites)

🟡 coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.283µs (SLO: <20.000µs 📉 -33.6%) vs baseline: +0.6%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ context_with_data_no_listeners

Time: ✅ 3.276µs (SLO: <10.000µs 📉 -67.2%) vs baseline: -0.2%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%

✅ get_item_exists

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: ~same

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%

✅ get_item_missing

Time: ✅ 0.634µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +0.5%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%

✅ set_item

Time: ✅ 24.211µs (SLO: <30.000µs 📉 -19.3%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.2%

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.592ms (SLO: <22.300ms 📉 -12.1%) vs baseline: ~same

Memory: ✅ 67.928MB (SLO: <70.500MB -3.6%) vs baseline: +4.5%

✅ exception-replay-enabled

Time: ✅ 1.362ms (SLO: <1.450ms -6.1%) vs baseline: +0.2%

Memory: ✅ 66.166MB (SLO: <67.500MB 🟡 -2.0%) vs baseline: +5.0%

✅ iast

Time: ✅ 19.580ms (SLO: <22.250ms 📉 -12.0%) vs baseline: -0.1%

Memory: ✅ 67.905MB (SLO: <70.000MB -3.0%) vs baseline: +4.7%

✅ profiler

Time: ✅ 15.513ms (SLO: <16.550ms -6.3%) vs baseline: +0.6%

Memory: ✅ 56.327MB (SLO: <57.500MB -2.0%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 19.419ms (SLO: <21.750ms 📉 -10.7%) vs baseline: -1.1%

Memory: ✅ 67.849MB (SLO: <70.500MB -3.8%) vs baseline: +4.4%

✅ span-code-origin

Time: ✅ 20.025ms (SLO: <28.200ms 📉 -29.0%) vs baseline: +1.1%

Memory: ✅ 68.012MB (SLO: <71.000MB -4.2%) vs baseline: +4.9%

✅ tracer

Time: ✅ 19.699ms (SLO: <21.750ms -9.4%) vs baseline: +0.9%

Memory: ✅ 67.751MB (SLO: <70.000MB -3.2%) vs baseline: +4.4%

✅ tracer-and-profiler

Time: ✅ 21.248ms (SLO: <23.500ms -9.6%) vs baseline: -0.2%

Memory: ✅ 69.344MB (SLO: <71.000MB -2.3%) vs baseline: +5.0%

✅ tracer-dont-create-db-spans

Time: ✅ 19.636ms (SLO: <21.500ms -8.7%) vs baseline: -0.4%

Memory: ✅ 67.846MB (SLO: <70.000MB -3.1%) vs baseline: +4.6%

✅ tracer-minimal

Time: ✅ 16.790ms (SLO: <17.500ms -4.1%) vs baseline: ~same

Memory: ✅ 67.790MB (SLO: <70.000MB -3.2%) vs baseline: +4.8%

✅ tracer-native

Time: ✅ 19.539ms (SLO: <21.750ms 📉 -10.2%) vs baseline: +0.5%

Memory: ✅ 67.869MB (SLO: <72.500MB -6.4%) vs baseline: +4.3%

✅ tracer-no-caches

Time: ✅ 17.620ms (SLO: <19.650ms 📉 -10.3%) vs baseline: ~same

Memory: ✅ 67.731MB (SLO: <70.000MB -3.2%) vs baseline: +4.8%

✅ tracer-no-databases

Time: ✅ 19.073ms (SLO: <20.100ms -5.1%) vs baseline: -0.6%

Memory: ✅ 67.869MB (SLO: <70.000MB -3.0%) vs baseline: +4.9%

✅ tracer-no-middleware

Time: ✅ 19.238ms (SLO: <21.500ms 📉 -10.5%) vs baseline: -0.3%

Memory: ✅ 67.771MB (SLO: <70.000MB -3.2%) vs baseline: +4.7%

✅ tracer-no-templates

Time: ✅ 19.465ms (SLO: <22.000ms 📉 -11.5%) vs baseline: +0.7%

Memory: ✅ 67.830MB (SLO: <70.500MB -3.8%) vs baseline: +4.6%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.309ms (SLO: <19.850ms 📉 -17.8%) vs baseline: ~same

Memory: ✅ 69.745MB (SLO: <70.000MB 🟡 -0.4%) vs baseline: +4.7%

✅ errortracking-enabled-user

Time: ✅ 16.319ms (SLO: <19.400ms 📉 -15.9%) vs baseline: +0.1%

Memory: ✅ 69.775MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +5.0%

✅ tracer-enabled

Time: ✅ 16.412ms (SLO: <19.450ms 📉 -15.6%) vs baseline: +0.6%

Memory: ✅ 69.714MB (SLO: <70.000MB 🟡 -0.4%) vs baseline: +4.7%

🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.063ms (SLO: <2.300ms 📉 -10.3%) vs baseline: -0.1%

Memory: ✅ 55.620MB (SLO: <56.500MB 🟡 -1.6%) vs baseline: +4.6%

✅ errortracking-enabled-user

Time: ✅ 2.075ms (SLO: <2.250ms -7.8%) vs baseline: ~same

Memory: ✅ 55.365MB (SLO: <56.500MB -2.0%) vs baseline: +4.0%

✅ tracer-enabled

Time: ✅ 2.061ms (SLO: <2.300ms 📉 -10.4%) vs baseline: ~same

Memory: ✅ 55.384MB (SLO: <56.500MB 🟡 -2.0%) vs baseline: +4.9%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.385ms (SLO: <4.750ms 📉 -28.7%) vs baseline: ~same

Memory: ✅ 55.483MB (SLO: <66.500MB 📉 -16.6%) vs baseline: +5.0%

✅ appsec-post

Time: ✅ 2.856ms (SLO: <6.750ms 📉 -57.7%) vs baseline: -0.2%

Memory: ✅ 55.839MB (SLO: <66.500MB 📉 -16.0%) vs baseline: +4.9%

✅ appsec-telemetry

Time: ✅ 3.398ms (SLO: <4.750ms 📉 -28.5%) vs baseline: +1.2%

Memory: ✅ 55.375MB (SLO: <66.500MB 📉 -16.7%) vs baseline: +4.7%

✅ debugger

Time: ✅ 1.873ms (SLO: <2.000ms -6.4%) vs baseline: +0.2%

Memory: ✅ 47.960MB (SLO: <49.500MB -3.1%) vs baseline: +4.8%

✅ iast-get

Time: ✅ 1.859ms (SLO: <2.000ms -7.1%) vs baseline: ~same

Memory: ✅ 44.577MB (SLO: <49.000MB -9.0%) vs baseline: +4.8%

✅ profiler

Time: ✅ 1.904ms (SLO: <2.100ms -9.3%) vs baseline: ~same

Memory: ✅ 48.829MB (SLO: <50.000MB -2.3%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 3.353ms (SLO: <3.650ms -8.1%) vs baseline: -0.2%

Memory: ✅ 55.434MB (SLO: <56.000MB 🟡 -1.0%) vs baseline: +4.8%

✅ tracer

Time: ✅ 3.367ms (SLO: <3.650ms -7.7%) vs baseline: -0.4%

Memory: ✅ 55.491MB (SLO: <56.500MB 🟡 -1.8%) vs baseline: +5.1%

✅ tracer-native

Time: ✅ 3.372ms (SLO: <3.650ms -7.6%) vs baseline: +0.1%

Memory: ✅ 55.505MB (SLO: <60.000MB -7.5%) vs baseline: +5.0%

🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.552µs (SLO: <100.000µs 📉 -18.4%) vs baseline: +0.6%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ b3_headers

Time: ✅ 14.385µs (SLO: <20.000µs 📉 -28.1%) vs baseline: +1.2%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%

✅ b3_single_headers

Time: ✅ 13.348µs (SLO: <20.000µs 📉 -33.3%) vs baseline: +0.5%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.4%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.261µs (SLO: <80.000µs 📉 -19.7%) vs baseline: +0.8%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.368µs (SLO: <80.000µs 📉 -17.0%) vs baseline: +0.6%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ empty_headers

Time: ✅ 1.632µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.8%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.3%

✅ full_t_id_datadog_headers

Time: ✅ 22.790µs (SLO: <30.000µs 📉 -24.0%) vs baseline: +1.6%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%

✅ invalid_priority_header

Time: ✅ 6.549µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.2%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%

✅ invalid_span_id_header

Time: ✅ 6.538µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.4%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ invalid_tags_header

Time: ✅ 6.496µs (SLO: <10.000µs 📉 -35.0%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ invalid_trace_id_header

Time: ✅ 6.521µs (SLO: <10.000µs 📉 -34.8%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ large_header_no_matches

Time: ✅ 27.653µs (SLO: <30.000µs -7.8%) vs baseline: +0.3%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ large_valid_headers_all

Time: ✅ 28.652µs (SLO: <40.000µs 📉 -28.4%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ medium_header_no_matches

Time: ✅ 9.845µs (SLO: <20.000µs 📉 -50.8%) vs baseline: -0.5%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.1%

✅ medium_valid_headers_all

Time: ✅ 11.296µs (SLO: <20.000µs 📉 -43.5%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

✅ none_propagation_style

Time: ✅ 1.732µs (SLO: <10.000µs 📉 -82.7%) vs baseline: +0.7%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ tracecontext_headers

Time: ✅ 34.703µs (SLO: <40.000µs 📉 -13.2%) vs baseline: +0.3%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%

✅ valid_headers_all

Time: ✅ 6.494µs (SLO: <10.000µs 📉 -35.1%) vs baseline: -0.5%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

✅ valid_headers_basic

Time: ✅ 6.122µs (SLO: <10.000µs 📉 -38.8%) vs baseline: +0.3%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ wsgi_empty_headers

Time: ✅ 1.623µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +1.1%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ wsgi_invalid_priority_header

Time: ✅ 6.589µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.3%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.609µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.3%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.5%

✅ wsgi_invalid_tags_header

Time: ✅ 6.576µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.2%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.649µs (SLO: <10.000µs 📉 -33.5%) vs baseline: +1.8%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%

✅ wsgi_large_header_no_matches

Time: ✅ 28.700µs (SLO: <40.000µs 📉 -28.2%) vs baseline: -0.1%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.915µs (SLO: <40.000µs 📉 -25.2%) vs baseline: +0.3%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.3%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.085µs (SLO: <20.000µs 📉 -49.6%) vs baseline: ~same

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.4%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.583µs (SLO: <20.000µs 📉 -42.1%) vs baseline: +0.3%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ wsgi_valid_headers_all

Time: ✅ 6.596µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.4%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ wsgi_valid_headers_basic

Time: ✅ 6.098µs (SLO: <10.000µs 📉 -39.0%) vs baseline: +0.1%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.165µs (SLO: <30.000µs 📉 -26.1%) vs baseline: +5.0%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ with_all

Time: ✅ 27.973µs (SLO: <40.000µs 📉 -30.1%) vs baseline: +0.1%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%

✅ with_dd_origin

Time: ✅ 24.819µs (SLO: <30.000µs 📉 -17.3%) vs baseline: -0.7%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%

✅ with_priority_and_origin

Time: ✅ 24.492µs (SLO: <40.000µs 📉 -38.8%) vs baseline: +0.3%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ with_sampling_priority

Time: ✅ 21.194µs (SLO: <30.000µs 📉 -29.4%) vs baseline: -0.6%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.5%

✅ with_tags

Time: ✅ 26.043µs (SLO: <40.000µs 📉 -34.9%) vs baseline: -0.7%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ with_tags_invalid

Time: ✅ 27.529µs (SLO: <40.000µs 📉 -31.2%) vs baseline: +0.2%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%

✅ with_tags_max_size

Time: ✅ 26.555µs (SLO: <40.000µs 📉 -33.6%) vs baseline: ~same

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

🟡 iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 34.064µs (SLO: <40.000µs 📉 -14.8%) vs baseline: +7.0%

Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +5.1%

✅ re_expand_noaspect

Time: ✅ 28.398µs (SLO: <40.000µs 📉 -29.0%) vs baseline: -1.3%

Memory: ✅ 40.344MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +5.4%

✅ re_findall_aspect

Time: ✅ 2.917µs (SLO: <10.000µs 📉 -70.8%) vs baseline: +0.2%

Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +5.0%

✅ re_findall_noaspect

Time: ✅ 1.403µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.6%

Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +4.7%

✅ re_finditer_aspect

Time: ✅ 4.453µs (SLO: <10.000µs 📉 -55.5%) vs baseline: -0.4%

Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +4.6%

✅ re_finditer_noaspect

Time: ✅ 1.402µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.4%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +5.0%

✅ re_fullmatch_aspect

Time: ✅ 2.698µs (SLO: <10.000µs 📉 -73.0%) vs baseline: -0.2%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.5%

✅ re_fullmatch_noaspect

Time: ✅ 1.323µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.3%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.7%

✅ re_group_aspect

Time: ✅ 2.984µs (SLO: <10.000µs 📉 -70.2%) vs baseline: -0.9%

Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.3%

✅ re_group_noaspect

Time: ✅ 1.625µs (SLO: <10.000µs 📉 -83.7%) vs baseline: -0.8%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.6%

✅ re_groups_aspect

Time: ✅ 3.142µs (SLO: <10.000µs 📉 -68.6%) vs baseline: -0.3%

Memory: ✅ 40.305MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.9%

✅ re_groups_noaspect

Time: ✅ 1.706µs (SLO: <10.000µs 📉 -82.9%) vs baseline: -0.1%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.8%

✅ re_match_aspect

Time: ✅ 2.751µs (SLO: <10.000µs 📉 -72.5%) vs baseline: -0.1%

Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.0%

✅ re_match_noaspect

Time: ✅ 1.308µs (SLO: <10.000µs 📉 -86.9%) vs baseline: -1.4%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.9%

✅ re_search_aspect

Time: ✅ 2.588µs (SLO: <10.000µs 📉 -74.1%) vs baseline: -0.4%

Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.6%

✅ re_search_noaspect

Time: ✅ 1.194µs (SLO: <10.000µs 📉 -88.1%) vs baseline: -0.6%

Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.8%

✅ re_sub_aspect

Time: ✅ 3.583µs (SLO: <10.000µs 📉 -64.2%) vs baseline: +4.9%

Memory: ✅ 40.305MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.1%

✅ re_sub_noaspect

Time: ✅ 1.523µs (SLO: <10.000µs 📉 -84.8%) vs baseline: -1.2%

Memory: ✅ 40.383MB (SLO: <41.000MB 🟡 -1.5%) vs baseline: +4.9%

✅ re_subn_aspect

Time: ✅ 3.694µs (SLO: <10.000µs 📉 -63.1%) vs baseline: +0.8%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +5.1%

✅ re_subn_noaspect

Time: ✅ 1.617µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +1.0%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.3%

🟡 iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.544µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +7.1%

Memory: ✅ 40.305MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.2%

✅ rsplit_noaspect

Time: ✅ 0.578µs (SLO: <10.000µs 📉 -94.2%) vs baseline: ~same

Memory: ✅ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.3%

✅ split_aspect

Time: ✅ 1.435µs (SLO: <10.000µs 📉 -85.6%) vs baseline: +1.8%

Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.8%

✅ split_noaspect

Time: ✅ 0.575µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.9%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.3%

✅ splitlines_aspect

Time: ✅ 1.418µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.7%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.8%

✅ splitlines_noaspect

Time: ✅ 0.585µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.9%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.6%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 39.612ms (SLO: <47.150ms 📉 -16.0%) vs baseline: +0.1%

Memory: ✅ 39.611MB (SLO: <47.000MB 📉 -15.7%) vs baseline: +5.4%

✅ add-metrics

Time: ✅ 261.890ms (SLO: <344.800ms 📉 -24.0%) vs baseline: +0.3%

Memory: ✅ 43.769MB (SLO: <47.500MB -7.9%) vs baseline: +5.2%

✅ add-tags

Time: ✅ 318.746ms (SLO: <321.000ms 🟡 -0.7%) vs baseline: +0.8%

Memory: ✅ 43.625MB (SLO: <47.500MB -8.2%) vs baseline: +4.9%

✅ get-context

Time: ✅ 79.936ms (SLO: <92.350ms 📉 -13.4%) vs baseline: ~same

Memory: ✅ 39.675MB (SLO: <46.500MB 📉 -14.7%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 37.051ms (SLO: <44.500ms 📉 -16.7%) vs baseline: -0.6%

Memory: ✅ 39.505MB (SLO: <47.500MB 📉 -16.8%) vs baseline: +5.2%

✅ record-exception

Time: ✅ 58.240ms (SLO: <67.650ms 📉 -13.9%) vs baseline: -0.2%

Memory: ✅ 39.784MB (SLO: <47.000MB 📉 -15.4%) vs baseline: +4.3%

✅ set-status

Time: ✅ 43.674ms (SLO: <50.400ms 📉 -13.3%) vs baseline: +0.1%

Memory: ✅ 39.354MB (SLO: <47.000MB 📉 -16.3%) vs baseline: +4.9%

✅ start

Time: ✅ 37.285ms (SLO: <43.450ms 📉 -14.2%) vs baseline: +2.3%

Memory: ✅ 39.393MB (SLO: <47.000MB 📉 -16.2%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 81.818ms (SLO: <88.000ms -7.0%) vs baseline: +0.2%

Memory: ✅ 37.297MB (SLO: <46.500MB 📉 -19.8%) vs baseline: +5.1%

✅ start-finish-telemetry

Time: ✅ 83.096ms (SLO: <89.000ms -6.6%) vs baseline: -0.4%

Memory: ✅ 37.297MB (SLO: <46.500MB 📉 -19.8%) vs baseline: +4.7%

✅ update-name

Time: ✅ 37.941ms (SLO: <45.150ms 📉 -16.0%) vs baseline: +0.2%

Memory: ✅ 39.563MB (SLO: <47.000MB 📉 -15.8%) vs baseline: +4.8%

🟡 packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.670ms (SLO: <354.300ms -3.3%) vs baseline: -0.8%

Memory: ✅ 40.774MB (SLO: <41.500MB 🟡 -1.7%) vs baseline: +5.7%

✅ cache_on

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.6%

Memory: ✅ 39.155MB (SLO: <41.000MB -4.5%) vs baseline: +5.4%

🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.373µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.3%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.7%

✅ high_rate_limit

Time: ✅ 2.436µs (SLO: <10.000µs 📉 -75.6%) vs baseline: -0.2%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.8%

✅ long_window

Time: ✅ 2.351µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.8%

Memory: ✅ 35.173MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +4.9%

✅ low_rate_limit

Time: ✅ 2.371µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.2%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.7%

✅ no_rate_limit

Time: ✅ 0.824µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -1.0%

Memory: ✅ 35.134MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +5.0%

✅ short_window

Time: ✅ 2.504µs (SLO: <10.000µs 📉 -75.0%) vs baseline: -0.2%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.7%

🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 308.620ms (SLO: <320.950ms -3.8%) vs baseline: ~same

Memory: ✅ 35.960MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.7%

✅ deep-profiled

Time: ✅ 328.426ms (SLO: <359.150ms -8.6%) vs baseline: ~same

Memory: ✅ 39.872MB (SLO: <40.500MB 🟡 -1.6%) vs baseline: +5.1%

✅ medium

Time: ✅ 6.993ms (SLO: <7.400ms -5.5%) vs baseline: +0.1%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%

✅ shallow

Time: ✅ 0.948ms (SLO: <1.050ms -9.8%) vs baseline: +1.2%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%

🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 137.759µs (SLO: <290.000µs 📉 -52.5%) vs baseline: -0.3%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%

✅ high_match

Time: ✅ 174.174µs (SLO: <480.000µs 📉 -63.7%) vs baseline: -1.2%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.2%

✅ low_match

Time: ✅ 99.556µs (SLO: <120.000µs 📉 -17.0%) vs baseline: +0.4%

Memory: ✅ 603.532MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.664ms (SLO: <8.500ms 📉 -68.7%) vs baseline: +0.6%

Memory: ✅ 71.009MB (SLO: <75.000MB -5.3%) vs baseline: +4.8%

🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.614µs (SLO: <20.000µs 📉 -46.9%) vs baseline: +0.2%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.6%

✅ all-enabled

Time: ✅ 41.078µs (SLO: <50.000µs 📉 -17.8%) vs baseline: +1.9%

Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +4.7%

✅ collectipvariant_exists

Time: ✅ 40.976µs (SLO: <50.000µs 📉 -18.0%) vs baseline: -0.2%

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +5.3%

✅ no-collectipvariant

Time: ✅ 40.228µs (SLO: <50.000µs 📉 -19.5%) vs baseline: -0.1%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.0%

✅ no-useragentvariant

Time: ✅ 39.029µs (SLO: <50.000µs 📉 -21.9%) vs baseline: +0.6%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.5%

✅ obfuscation-no-query

Time: ✅ 40.724µs (SLO: <50.000µs 📉 -18.6%) vs baseline: +0.2%

Memory: ✅ 35.507MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +5.2%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.895µs (SLO: <90.000µs 📉 -15.7%) vs baseline: +0.4%

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +5.0%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.623µs (SLO: <90.000µs 📉 -14.9%) vs baseline: +0.2%

Memory: ✅ 35.625MB (SLO: <36.500MB -2.4%) vs baseline: +4.9%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.224µs (SLO: <170.000µs -9.3%) vs baseline: -0.1%

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +4.8%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.542µs (SLO: <160.000µs -7.2%) vs baseline: -0.2%

Memory: ✅ 35.645MB (SLO: <36.500MB -2.3%) vs baseline: +4.6%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.929µs (SLO: <170.000µs -8.9%) vs baseline: -0.1%

Memory: ✅ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.646µs (SLO: <50.000µs 📉 -20.7%) vs baseline: -0.3%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.0%

✅ useragentvariant_exists_2

Time: ✅ 40.752µs (SLO: <50.000µs 📉 -18.5%) vs baseline: ~same

Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.2%

✅ useragentvariant_exists_3

Time: ✅ 40.135µs (SLO: <50.000µs 📉 -19.7%) vs baseline: -0.5%

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +4.9%

✅ useragentvariant_not_exists_1

Time: ✅ 39.722µs (SLO: <50.000µs 📉 -20.6%) vs baseline: ~same

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.9%

✅ useragentvariant_not_exists_2

Time: ✅ 39.732µs (SLO: <50.000µs 📉 -20.5%) vs baseline: ~same

Memory: ✅ 35.350MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.3%

🟡 tracer - 6/6

✅ large

Time: ✅ 29.323ms (SLO: <32.950ms 📉 -11.0%) vs baseline: +0.7%

Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +5.1%

✅ medium

Time: ✅ 2.888ms (SLO: <3.200ms -9.8%) vs baseline: ~same

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.9%

✅ small

Time: ✅ 331.716µs (SLO: <370.000µs 📉 -10.3%) vs baseline: +1.7%

Memory: ✅ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.7%

⚠️ Unstable Tests (1 suite)

⚠️

packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 154.487µs (SLO: <170.000µs -9.1%) vs baseline: +0.3%

Memory: ✅ 39.526MB (SLO: <41.000MB -3.6%) vs baseline: +4.8%

✅ import_many_cached

Time: ✅ 122.003µs (SLO: <130.000µs -6.2%) vs baseline: +0.9%

Memory: ✅ 39.489MB (SLO: <41.000MB -3.7%) vs baseline: +5.0%

✅ import_many_stdlib

Time: ✅ 0.755ms (SLO: <1.750ms 📉 -56.9%) vs baseline: ~same

Memory: ✅ 39.417MB (SLO: <41.000MB -3.9%) vs baseline: +4.5%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.171ms (SLO: <1.100ms 📉 -84.5%) vs baseline: -1.1%

Memory: ✅ 39.385MB (SLO: <41.000MB -3.9%) vs baseline: +5.0%

✅ import_many_unknown

Time: ✅ 831.904µs (SLO: <890.000µs -6.5%) vs baseline: ~same

Memory: ✅ 39.390MB (SLO: <41.000MB -3.9%) vs baseline: +4.4%

✅ import_many_unknown_cached

Time: ✅ 791.064µs (SLO: <870.000µs -9.1%) vs baseline: ~same

Memory: ✅ 39.567MB (SLO: <41.000MB -3.5%) vs baseline: +4.9%

✅ import_one

Time: ✅ 19.701µs (SLO: <30.000µs 📉 -34.3%) vs baseline: ~same

Memory: ✅ 39.502MB (SLO: <41.000MB -3.7%) vs baseline: +5.1%

✅ import_one_cache

Time: ✅ 6.260µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -0.6%

Memory: ✅ 39.495MB (SLO: <41.000MB -3.7%) vs baseline: +5.5%

✅ import_one_stdlib

Time: ✅ 18.665µs (SLO: <20.000µs -6.7%) vs baseline: +0.3%

Memory: ✅ 39.437MB (SLO: <41.000MB -3.8%) vs baseline: +5.4%

✅ import_one_stdlib_cache

Time: ✅ 6.267µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.4%

Memory: ✅ 39.430MB (SLO: <41.000MB -3.8%) vs baseline: +4.8%

✅ import_one_unknown

Time: ✅ 45.280µs (SLO: <50.000µs -9.4%) vs baseline: +0.2%

Memory: ✅ 39.403MB (SLO: <41.000MB -3.9%) vs baseline: +5.3%

✅ import_one_unknown_cache

Time: ✅ 6.291µs (SLO: <10.000µs 📉 -37.1%) vs baseline: ~same

Memory: ✅ 39.616MB (SLO: <41.000MB -3.4%) vs baseline: +5.6%

✅ All Tests Passing (4 suites)

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.056ms (SLO: <4.200ms 📉 -51.0%) vs baseline: ~same

Memory: ✅ 55.365MB (SLO: <66.000MB 📉 -16.1%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.069ms (SLO: <2.800ms 📉 -26.1%) vs baseline: +0.4%

Memory: ✅ 55.404MB (SLO: <62.500MB 📉 -11.4%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.058ms (SLO: <2.250ms -8.5%) vs baseline: +0.3%

Memory: ✅ 55.365MB (SLO: <56.500MB -2.0%) vs baseline: +4.8%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.445µs (SLO: <60.000µs 📉 -19.3%) vs baseline: ~same

Memory: ✅ 40.069MB (SLO: <42.000MB -4.6%) vs baseline: +4.7%

✅ propagation_enabled

Time: ✅ 173.430µs (SLO: <190.000µs -8.7%) vs baseline: +0.2%

Memory: ✅ 40.128MB (SLO: <42.000MB -4.5%) vs baseline: +4.9%

✅ propagation_enabled_100

Time: ✅ 1.919ms (SLO: <2.300ms 📉 -16.6%) vs baseline: -1.0%

Memory: ✅ 40.069MB (SLO: <42.000MB -4.6%) vs baseline: +4.8%

✅ propagation_enabled_1000

Time: ✅ 32.722ms (SLO: <34.550ms -5.3%) vs baseline: +0.2%

Memory: ✅ 40.108MB (SLO: <42.000MB -4.5%) vs baseline: +4.9%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.144ms (SLO: <42.000ms -4.4%) vs baseline: -0.8%

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +4.5%

✅ add-link

Time: ✅ 36.365ms (SLO: <38.550ms -5.7%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.0%

✅ add-metrics

Time: ✅ 218.875ms (SLO: <232.000ms -5.7%) vs baseline: -0.8%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +3.9%

✅ add-tags

Time: ✅ 211.031ms (SLO: <221.600ms -4.8%) vs baseline: -1.0%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.4%

✅ get-context

Time: ✅ 29.281ms (SLO: <31.300ms -6.5%) vs baseline: +0.8%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 29.323ms (SLO: <31.000ms -5.4%) vs baseline: +0.5%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.2%

✅ record-exception

Time: ✅ 63.133ms (SLO: <65.850ms -4.1%) vs baseline: +0.3%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.5%

✅ set-status

Time: ✅ 31.995ms (SLO: <34.150ms -6.3%) vs baseline: +1.0%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.5%

✅ start

Time: ✅ 29.319ms (SLO: <30.150ms -2.8%) vs baseline: +1.9%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.1%

✅ start-finish

Time: ✅ 33.983ms (SLO: <35.350ms -3.9%) vs baseline: +0.7%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.4%

✅ start-finish-telemetry

Time: ✅ 33.914ms (SLO: <35.450ms -4.3%) vs baseline: +0.1%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.1%

✅ update-name

Time: ✅ 31.103ms (SLO: <33.400ms -6.9%) vs baseline: +0.5%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.5%

✅ span - 26/26

✅ add-event

Time: ✅ 18.226ms (SLO: <22.500ms 📉 -19.0%) vs baseline: +0.7%

Memory: ✅ 36.867MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 88.022ms (SLO: <93.500ms -5.9%) vs baseline: -0.8%

Memory: ✅ 41.147MB (SLO: <53.000MB 📉 -22.4%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 142.593ms (SLO: <155.000ms -8.0%) vs baseline: ~same

Memory: ✅ 41.120MB (SLO: <53.000MB 📉 -22.4%) vs baseline: +5.0%

✅ get-context

Time: ✅ 16.979ms (SLO: <20.500ms 📉 -17.2%) vs baseline: ~same

Memory: ✅ 36.726MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 17.344ms (SLO: <20.500ms 📉 -15.4%) vs baseline: +0.4%

Memory: ✅ 36.684MB (SLO: <53.000MB 📉 -30.8%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 36.862ms (SLO: <40.000ms -7.8%) vs baseline: +1.1%

Memory: ✅ 37.331MB (SLO: <53.000MB 📉 -29.6%) vs baseline: +5.1%

✅ set-status

Time: ✅ 18.789ms (SLO: <22.000ms 📉 -14.6%) vs baseline: -0.3%

Memory: ✅ 36.745MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +5.0%

✅ start

Time: ✅ 17.459ms (SLO: <20.500ms 📉 -14.8%) vs baseline: +2.9%

Memory: ✅ 36.618MB (SLO: <53.000MB 📉 -30.9%) vs baseline: +4.5%

✅ start-finish

Time: ✅ 50.913ms (SLO: <52.500ms -3.0%) vs baseline: ~same

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 52.474ms (SLO: <54.500ms -3.7%) vs baseline: +0.1%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

✅ start-finish-traceid128

Time: ✅ 54.274ms (SLO: <57.000ms -4.8%) vs baseline: -0.1%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.1%

✅ start-traceid128

Time: ✅ 17.297ms (SLO: <22.500ms 📉 -23.1%) vs baseline: +0.5%

Memory: ✅ 36.738MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +5.0%

✅ update-name

Time: ✅ 17.305ms (SLO: <22.000ms 📉 -21.3%) vs baseline: -0.2%

Memory: ✅ 36.842MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.6%

ℹ️ Scenarios Missing SLO Configuration (10 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline
sethttpmeta-obfuscation-disabled

By tricking the check to think it's on master. dd-trace-py doesn't even use master, so this will not negatively affect metrics.

emmettbutler

thank you for doing this

igoragoli force-pushed the augusto/apmsp-2373.update-slo-check branch from 0f4bc7f to 8f283e7 Compare November 26, 2025 09:08

igoragoli marked this pull request as ready for review November 26, 2025 10:19

igoragoli requested review from a team as code owners November 26, 2025 10:19

igoragoli requested review from christophe-papazian and emmettbutler November 26, 2025 10:19

igoragoli changed the title ~~Augusto/apmsp 2373.update slo check~~ ci: add microbench SLO change detection, fix bench interruptible policy Nov 26, 2025

igoragoli marked this pull request as draft November 26, 2025 10:34

igoragoli added the changelog/no-changelog A changelog entry is not required for this PR. label Nov 26, 2025

igoragoli marked this pull request as ready for review November 26, 2025 10:57

christophe-papazian approved these changes Nov 27, 2025

View reviewed changes

juanjux approved these changes Nov 27, 2025

View reviewed changes

igoragoli added 14 commits November 28, 2025 10:48

add comment explaining why we don't use when: always

f47df04

add slo change detection

54a2df8

improve comment explaining why we don't use when: always for SLO check

edf2787

add explicit when: on_success

841695d

add .check-slo-breaches template

cacc6a6

remove tags, add comment to remove image

9800190

test SLO change detection

26c6385

By tricking the check to think it's on master. dd-trace-py doesn't even use master, so this will not negatively affect metrics.

trigger ci

ea682f3

test if check-slo-breaches is interruptible

e35062e

test if check-slo-breaches is interruptible

38e3f73

test if check-slo-breaches is interruptible

8e17ccf

trigger ci

1ec0dab

workflow auto_cancel: on_new_commit on microbenchmarks

4d5b8c3

trigger ci

348ff29

igoragoli added 4 commits November 28, 2025 10:48

workflow auto_cancel: on_new_commit on macrobenchmarks

4c82654

revert changes made for testing

7424109

complete TODO for removing the image key on check-slo-breaches

4e75a35

remove microbenchmarks' when: on_success since it's the default behavior

3a0d6dd

igoragoli force-pushed the augusto/apmsp-2373.update-slo-check branch from 8d44d7b to 3a0d6dd Compare November 28, 2025 09:48

igoragoli added 2 commits December 1, 2025 08:10

Merge branch 'main' into augusto/apmsp-2373.update-slo-check

2c45e11

Merge branch 'main' into augusto/apmsp-2373.update-slo-check

9c9ca76

emmettbutler approved these changes Dec 2, 2025

View reviewed changes

emmettbutler and others added 2 commits December 2, 2025 07:21

Merge branch 'main' into augusto/apmsp-2373.update-slo-check

eb7e477

Merge branch 'main' into augusto/apmsp-2373.update-slo-check

b5f4e6e

igoragoli merged commit 518562a into main Dec 3, 2025
971 checks passed

igoragoli deleted the augusto/apmsp-2373.update-slo-check branch December 3, 2025 08:01

ci: add microbench SLO change detection, fix bench interruptible policy #15417

ci: add microbench SLO change detection, fix bench interruptible policy #15417

Conversation

igoragoli commented Nov 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Testing

Risks

Additional Notes

Uh oh!

github-actions bot commented Nov 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Nov 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Nov 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ add_aspect

✅ add_inplace_aspect

✅ add_inplace_noaspect

✅ add_noaspect

✅ bytearray_aspect

✅ bytearray_extend_aspect

✅ bytearray_extend_noaspect

✅ bytearray_noaspect

✅ bytes_aspect

✅ bytes_noaspect

✅ bytesio_aspect

✅ bytesio_noaspect

✅ capitalize_aspect

✅ capitalize_noaspect

✅ casefold_aspect

✅ casefold_noaspect

✅ decode_aspect

✅ decode_noaspect

✅ encode_aspect

✅ encode_noaspect

✅ format_aspect

✅ format_map_aspect

✅ format_map_noaspect

✅ format_noaspect

✅ index_aspect

✅ index_noaspect

✅ join_aspect

✅ join_noaspect

✅ ljust_aspect

✅ ljust_noaspect

✅ lower_aspect

✅ lower_noaspect

✅ lstrip_aspect

✅ lstrip_noaspect

✅ modulo_aspect

✅ modulo_aspect_for_bytearray_bytearray

✅ modulo_aspect_for_bytes

✅ modulo_aspect_for_bytes_bytearray

✅ modulo_noaspect

✅ replace_aspect

✅ replace_noaspect

✅ repr_aspect

✅ repr_noaspect

✅ rstrip_aspect

✅ rstrip_noaspect

✅ slice_aspect

✅ slice_noaspect

✅ stringio_aspect

✅ stringio_noaspect

✅ strip_aspect

✅ strip_noaspect

✅ swapcase_aspect

✅ swapcase_noaspect

✅ title_aspect

✅ title_noaspect

✅ translate_aspect

✅ translate_noaspect

✅ upper_aspect

igoragoli commented Nov 25, 2025 •

edited

Loading

github-actions bot commented Nov 25, 2025 •

edited

Loading

github-actions bot commented Nov 25, 2025 •

edited

Loading

pr-commenter bot commented Nov 26, 2025 •

edited

Loading