-
Notifications
You must be signed in to change notification settings - Fork 474
ci(profiling): attempt to fix fork test #15700
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
ci(profiling): attempt to fix fork test #15700
Conversation
|
|
Performance SLOsComparing candidate kowalski/ci-profiling-attempt-to-fix-fork-test (be8d757) with baseline main (151e610) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 18.265µs (SLO: <20.000µs -8.7%) vs baseline: 📈 +22.0% Memory: ✅ 42.762MB (SLO: <43.250MB 🟡 -1.1%) vs baseline: +4.6% ✅ add_inplace_aspectTime: ✅ 14.975µs (SLO: <20.000µs 📉 -25.1%) vs baseline: -0.3% Memory: ✅ 42.723MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +4.5% ✅ add_inplace_noaspectTime: ✅ 0.337µs (SLO: <10.000µs 📉 -96.6%) vs baseline: -0.7% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.7% ✅ add_noaspectTime: ✅ 0.544µs (SLO: <10.000µs 📉 -94.6%) vs baseline: -1.2% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.8% ✅ bytearray_aspectTime: ✅ 18.051µs (SLO: <30.000µs 📉 -39.8%) vs baseline: +0.2% Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.5% ✅ bytearray_extend_aspectTime: ✅ 23.843µs (SLO: <30.000µs 📉 -20.5%) vs baseline: -0.6% Memory: ✅ 42.762MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.7% ✅ bytearray_extend_noaspectTime: ✅ 2.676µs (SLO: <10.000µs 📉 -73.2%) vs baseline: +1.0% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.6% ✅ bytearray_noaspectTime: ✅ 1.439µs (SLO: <10.000µs 📉 -85.6%) vs baseline: -0.7% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ bytes_aspectTime: ✅ 16.781µs (SLO: <20.000µs 📉 -16.1%) vs baseline: +0.2% Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.6% ✅ bytes_noaspectTime: ✅ 1.391µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -0.4% Memory: ✅ 42.762MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.1% ✅ bytesio_aspectTime: ✅ 55.290µs (SLO: <70.000µs 📉 -21.0%) vs baseline: ~same Memory: ✅ 42.762MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.2% ✅ bytesio_noaspectTime: ✅ 3.224µs (SLO: <10.000µs 📉 -67.8%) vs baseline: +0.4% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.4% ✅ capitalize_aspectTime: ✅ 14.706µs (SLO: <20.000µs 📉 -26.5%) vs baseline: +0.3% Memory: ✅ 42.841MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.9% ✅ capitalize_noaspectTime: ✅ 2.557µs (SLO: <10.000µs 📉 -74.4%) vs baseline: ~same Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.4% ✅ casefold_aspectTime: ✅ 14.756µs (SLO: <20.000µs 📉 -26.2%) vs baseline: +0.5% Memory: ✅ 42.762MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.1% ✅ casefold_noaspectTime: ✅ 3.115µs (SLO: <10.000µs 📉 -68.9%) vs baseline: +0.6% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.3% ✅ decode_aspectTime: ✅ 15.702µs (SLO: <30.000µs 📉 -47.7%) vs baseline: +0.3% Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.0% ✅ decode_noaspectTime: ✅ 1.582µs (SLO: <10.000µs 📉 -84.2%) vs baseline: -1.3% Memory: ✅ 42.782MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +5.1% ✅ encode_aspectTime: ✅ 18.399µs (SLO: <30.000µs 📉 -38.7%) vs baseline: 📈 +23.0% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.1% ✅ encode_noaspectTime: ✅ 1.457µs (SLO: <10.000µs 📉 -85.4%) vs baseline: -0.5% Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +5.1% ✅ format_aspectTime: ✅ 171.067µs (SLO: <200.000µs 📉 -14.5%) vs baseline: +0.1% Memory: ✅ 42.900MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.7% ✅ format_map_aspectTime: ✅ 191.391µs (SLO: <200.000µs -4.3%) vs baseline: -0.1% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +5.1% ✅ format_map_noaspectTime: ✅ 3.752µs (SLO: <10.000µs 📉 -62.5%) vs baseline: -0.2% Memory: ✅ 42.703MB (SLO: <43.250MB 🟡 -1.3%) vs baseline: +5.0% ✅ format_noaspectTime: ✅ 3.136µs (SLO: <10.000µs 📉 -68.6%) vs baseline: -0.5% Memory: ✅ 42.644MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.7% ✅ index_aspectTime: ✅ 15.332µs (SLO: <20.000µs 📉 -23.3%) vs baseline: ~same Memory: ✅ 42.900MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.4% ✅ index_noaspectTime: ✅ 0.467µs (SLO: <10.000µs 📉 -95.3%) vs baseline: +0.2% Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.7% ✅ join_aspectTime: ✅ 16.955µs (SLO: <20.000µs 📉 -15.2%) vs baseline: -0.6% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.2% ✅ join_noaspectTime: ✅ 1.489µs (SLO: <10.000µs 📉 -85.1%) vs baseline: +0.6% Memory: ✅ 42.703MB (SLO: <43.250MB 🟡 -1.3%) vs baseline: +4.8% ✅ ljust_aspectTime: ✅ 20.674µs (SLO: <30.000µs 📉 -31.1%) vs baseline: -1.1% Memory: ✅ 42.743MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +4.4% ✅ ljust_noaspectTime: ✅ 2.650µs (SLO: <10.000µs 📉 -73.5%) vs baseline: ~same Memory: ✅ 42.743MB (SLO: <43.250MB 🟡 -1.2%) vs baseline: +5.1% ✅ lower_aspectTime: ✅ 17.868µs (SLO: <30.000µs 📉 -40.4%) vs baseline: +0.4% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.5% ✅ lower_noaspectTime: ✅ 2.392µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +0.3% Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.6% ✅ lstrip_aspectTime: ✅ 17.743µs (SLO: <20.000µs 📉 -11.3%) vs baseline: +0.2% Memory: ✅ 42.566MB (SLO: <43.250MB 🟡 -1.6%) vs baseline: +4.4% ✅ lstrip_noaspectTime: ✅ 1.847µs (SLO: <10.000µs 📉 -81.5%) vs baseline: +0.9% Memory: ✅ 42.743MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.7% ✅ modulo_aspectTime: ✅ 166.578µs (SLO: <200.000µs 📉 -16.7%) vs baseline: ~same Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.5% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 179.532µs (SLO: <200.000µs 📉 -10.2%) vs baseline: +2.4% Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.2% ✅ modulo_aspect_for_bytesTime: ✅ 168.601µs (SLO: <200.000µs 📉 -15.7%) vs baseline: ~same Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 171.415µs (SLO: <200.000µs 📉 -14.3%) vs baseline: -0.4% Memory: ✅ 42.762MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.0% ✅ modulo_noaspectTime: ✅ 3.689µs (SLO: <10.000µs 📉 -63.1%) vs baseline: +0.5% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.8% ✅ replace_aspectTime: ✅ 212.116µs (SLO: <300.000µs 📉 -29.3%) vs baseline: -0.2% Memory: ✅ 42.762MB (SLO: <44.000MB -2.8%) vs baseline: +5.0% ✅ replace_noaspectTime: ✅ 2.832µs (SLO: <10.000µs 📉 -71.7%) vs baseline: +0.3% Memory: ✅ 42.782MB (SLO: <43.500MB 🟡 -1.7%) vs baseline: +4.6% ✅ repr_aspectTime: ✅ 1.379µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.5% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ repr_noaspectTime: ✅ 0.527µs (SLO: <10.000µs 📉 -94.7%) vs baseline: +0.2% Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.6% ✅ rstrip_aspectTime: ✅ 19.265µs (SLO: <30.000µs 📉 -35.8%) vs baseline: +0.9% Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.6% ✅ rstrip_noaspectTime: ✅ 1.910µs (SLO: <10.000µs 📉 -80.9%) vs baseline: +2.0% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.5% ✅ slice_aspectTime: ✅ 15.986µs (SLO: <20.000µs 📉 -20.1%) vs baseline: -0.7% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.4% ✅ slice_noaspectTime: ✅ 0.601µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +1.0% Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8% ✅ stringio_aspectTime: ✅ 54.004µs (SLO: <80.000µs 📉 -32.5%) vs baseline: -0.3% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.6% ✅ stringio_noaspectTime: ✅ 3.555µs (SLO: <10.000µs 📉 -64.4%) vs baseline: +0.9% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ strip_aspectTime: ✅ 17.675µs (SLO: <20.000µs 📉 -11.6%) vs baseline: -0.3% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.4% ✅ strip_noaspectTime: ✅ 1.822µs (SLO: <10.000µs 📉 -81.8%) vs baseline: -0.7% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.6% ✅ swapcase_aspectTime: ✅ 18.472µs (SLO: <30.000µs 📉 -38.4%) vs baseline: -0.1% Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +5.0% ✅ swapcase_noaspectTime: ✅ 2.757µs (SLO: <10.000µs 📉 -72.4%) vs baseline: +0.1% Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +4.5% ✅ title_aspectTime: ✅ 18.231µs (SLO: <20.000µs -8.8%) vs baseline: -0.2% Memory: ✅ 42.959MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.8% ✅ title_noaspectTime: ✅ 2.633µs (SLO: <10.000µs 📉 -73.7%) vs baseline: -1.4% Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.5% ✅ translate_aspectTime: ✅ 24.065µs (SLO: <30.000µs 📉 -19.8%) vs baseline: 📈 +17.7% Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8% ✅ translate_noaspectTime: ✅ 4.233µs (SLO: <10.000µs 📉 -57.7%) vs baseline: +0.1% Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ upper_aspectTime: ✅ 17.921µs (SLO: <30.000µs 📉 -40.3%) vs baseline: ~same Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.8% ✅ upper_noaspectTime: ✅ 2.378µs (SLO: <10.000µs 📉 -76.2%) vs baseline: ~same Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +5.3% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 5.178µs (SLO: <10.000µs 📉 -48.2%) vs baseline: 📈 +21.3% Memory: ✅ 41.386MB (SLO: <43.500MB -4.9%) vs baseline: +4.8% ✅ ospathbasename_noaspectTime: ✅ 4.288µs (SLO: <10.000µs 📉 -57.1%) vs baseline: -0.9% Memory: ✅ 41.445MB (SLO: <43.500MB -4.7%) vs baseline: +5.0% ✅ ospathjoin_aspectTime: ✅ 6.096µs (SLO: <10.000µs 📉 -39.0%) vs baseline: -0.9% Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.6% ✅ ospathjoin_noaspectTime: ✅ 6.201µs (SLO: <10.000µs 📉 -38.0%) vs baseline: -0.4% Memory: ✅ 41.327MB (SLO: <43.500MB -5.0%) vs baseline: +4.6% ✅ ospathnormcase_aspectTime: ✅ 3.505µs (SLO: <10.000µs 📉 -65.0%) vs baseline: ~same Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.9% ✅ ospathnormcase_noaspectTime: ✅ 3.597µs (SLO: <10.000µs 📉 -64.0%) vs baseline: +0.3% Memory: ✅ 41.406MB (SLO: <43.500MB -4.8%) vs baseline: +4.7% ✅ ospathsplit_aspectTime: ✅ 4.853µs (SLO: <10.000µs 📉 -51.5%) vs baseline: -0.1% Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.8% ✅ ospathsplit_noaspectTime: ✅ 4.933µs (SLO: <10.000µs 📉 -50.7%) vs baseline: ~same Memory: ✅ 41.347MB (SLO: <43.500MB -5.0%) vs baseline: +4.7% ✅ ospathsplitdrive_aspectTime: ✅ 3.747µs (SLO: <10.000µs 📉 -62.5%) vs baseline: -1.0% Memory: ✅ 41.347MB (SLO: <43.500MB -5.0%) vs baseline: +4.5% ✅ ospathsplitdrive_noaspectTime: ✅ 0.748µs (SLO: <10.000µs 📉 -92.5%) vs baseline: -0.5% Memory: ✅ 41.445MB (SLO: <43.500MB -4.7%) vs baseline: +4.8% ✅ ospathsplitext_aspectTime: ✅ 4.648µs (SLO: <10.000µs 📉 -53.5%) vs baseline: +0.3% Memory: ✅ 41.386MB (SLO: <43.500MB -4.9%) vs baseline: +4.8% ✅ ospathsplitext_noaspectTime: ✅ 4.727µs (SLO: <10.000µs 📉 -52.7%) vs baseline: +0.6% Memory: ✅ 41.366MB (SLO: <43.500MB -4.9%) vs baseline: +4.8% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.340µs (SLO: <20.000µs 📉 -83.3%) vs baseline: 📈 +11.0% Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.0% ✅ 1-count-metrics-100-timesTime: ✅ 200.665µs (SLO: <220.000µs -8.8%) vs baseline: -0.2% Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ 1-distribution-metric-1-timesTime: ✅ 3.366µs (SLO: <20.000µs 📉 -83.2%) vs baseline: -0.4% Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1% ✅ 1-distribution-metrics-100-timesTime: ✅ 217.081µs (SLO: <230.000µs -5.6%) vs baseline: -0.8% Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9% ✅ 1-gauge-metric-1-timesTime: ✅ 2.194µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -1.6% Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ 1-gauge-metrics-100-timesTime: ✅ 136.056µs (SLO: <150.000µs -9.3%) vs baseline: -0.5% Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6% ✅ 1-rate-metric-1-timesTime: ✅ 3.163µs (SLO: <20.000µs 📉 -84.2%) vs baseline: -0.9% Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0% ✅ 1-rate-metrics-100-timesTime: ✅ 213.997µs (SLO: <250.000µs 📉 -14.4%) vs baseline: -0.8% Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9% ✅ 100-count-metrics-100-timesTime: ✅ 20.178ms (SLO: <22.000ms -8.3%) vs baseline: -0.8% Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.272ms (SLO: <2.550ms 📉 -10.9%) vs baseline: -0.9% Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.423ms (SLO: <1.550ms -8.2%) vs baseline: +1.4% Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6% ✅ 100-rate-metrics-100-timesTime: ✅ 2.225ms (SLO: <2.550ms 📉 -12.8%) vs baseline: +0.8% Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9% ✅ flush-1-metricTime: ✅ 4.628µs (SLO: <20.000µs 📉 -76.9%) vs baseline: -0.7% Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6% ✅ flush-100-metricsTime: ✅ 175.412µs (SLO: <250.000µs 📉 -29.8%) vs baseline: -0.2% Memory: ✅ 35.193MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +4.9% ✅ flush-1000-metricsTime: ✅ 2.169ms (SLO: <2.500ms 📉 -13.2%) vs baseline: -0.5% Memory: ✅ 36.019MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +4.9% 🟡 Near SLO Breach (15 suites)🟡 coreapiscenario - 10/10 (1 unstable)
|
Description
This is an attempt to fix the issue we have in Profiling stress tests, that we often see in Github Actions e.g.