Skip to content

example PR introducing performance regression #80

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

mdjastrzebski
Copy link
Member

Summary

This PR intentionally introduces performance regression to showcase how Reassure detects and present such case.

Test plan

@mdjastrzebski mdjastrzebski force-pushed the feat/regression-example branch 2 times, most recently from d649879 to 4d87a25 Compare January 31, 2025 12:55
@mdjastrzebski mdjastrzebski force-pushed the feat/regression-example branch from 4d87a25 to fc93e6a Compare January 31, 2025 13:11
@callstack callstack deleted a comment from github-actions bot Jan 31, 2025
Copy link

Performance Comparison Report

  • Current: 395cfe7 - 2025-01-31 13:12:48Z
  • Baseline: main (2ae59bd) - 2025-01-31 13:12:28Z

Significant Changes To Duration

Show entries
Name Type Duration Count
Web Vite - AsyncComponent (10 runs) render 41.4 ms → 49.1 ms (+7.7 ms, +18.5%) 🔴 4 → 5 (+1, +25.0%) 🔴
Web Vite - AsyncComponent (50 runs) render 41.6 ms → 49.1 ms (+7.5 ms, +18.0%) 🔴 4 → 5 (+1, +25.0%) 🔴
Web Vite - TestList (100 items) render 10.7 ms → 14.5 ms (+3.8 ms, +35.6%) 🔴🔴 1 → 2 (+1, +100.0%) 🔴
Show details
Name Type Duration Count
Web Vite - AsyncComponent (10 runs) render Baseline
Mean: 41.4 ms
Stdev: 0.3 ms (0.7%)
Runs: 41.3 41.6 41.1 41.3 41.4 42.0 41.4 41.7 41.0 41.4
Warmup runs: 51.1

Current
Mean: 49.1 ms
Stdev: 1.2 ms (2.5%)
Runs: 48.7 52.5 48.9 48.5 48.5 48.8 49.2 48.2 48.6 49.0
Warmup runs: 65.1
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4
Render issues:

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5
Render issues:
- Initial updates: 1
Web Vite - AsyncComponent (50 runs) render Baseline
Mean: 41.6 ms
Stdev: 1.3 ms (3.2%)
Runs: 41.4 41.3 41.4 41.4 41.2 41.5 40.8 41.5 41.4 41.2 41.5 40.7 42.8 41.4 41.4 41.2 41.0 41.1 42.4 42.6 47.9 41.4 41.4 41.2 41.1 41.1 41.4 47.6 41.3 40.9 41.5 41.6 41.4 41.3 41.9 41.4 41.5 41.2 41.3 40.7 41.2 41.2 41.3 41.0 41.1 41.2 40.9 41.3 41.1 41.5
Warmup runs: 41.3

Current
Mean: 49.1 ms
Stdev: 1.2 ms (2.5%)
Runs: 48.7 48.7 48.5 49.0 48.8 48.9 49.3 48.4 48.7 48.3 48.8 48.8 48.6 48.4 48.8 49.2 49.1 48.8 50.6 48.9 48.6 51.1 48.8 48.7 48.4 48.6 49.6 48.6 49.5 48.2 49.0 48.6 49.0 48.7 48.7 48.6 49.1 48.9 50.3 48.9 48.4 48.3 48.4 48.7 48.7 48.7 49.1 50.8 56.4 49.1
Warmup runs: 48.9
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
Render issues:

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5
Render issues:
- Initial updates: 1
Web Vite - TestList (100 items) render Baseline
Mean: 10.7 ms
Stdev: 0.1 ms (1.1%)
Runs: 10.7 11.0 10.7 10.6 10.6 10.7 10.6 10.7 10.9 10.7
Warmup runs: 10.9

Current
Mean: 14.5 ms
Stdev: 0.7 ms (5.1%)
Runs: 14.6 16.2 15.6 14.2 14.2 14.2 14.0 14.1 14.1 14.3
Warmup runs: 15.0
Baseline
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1
Render issues:

Current
Mean: 2
Stdev: 0 (0.0%)
Runs: 2 2 2 2 2 2 2 2 2 2
Render issues:
- Initial updates: 1

Meaningless Changes To Duration

There are no entries

Render Count Changes

Show entries
Name Type Duration Count
Web Vite - AsyncComponent (10 runs) render 41.4 ms → 49.1 ms (+7.7 ms, +18.5%) 🔴 4 → 5 (+1, +25.0%) 🔴
Web Vite - AsyncComponent (50 runs) render 41.6 ms → 49.1 ms (+7.5 ms, +18.0%) 🔴 4 → 5 (+1, +25.0%) 🔴
Web Vite - TestList (100 items) render 10.7 ms → 14.5 ms (+3.8 ms, +35.6%) 🔴🔴 1 → 2 (+1, +100.0%) 🔴
Show details
Name Type Duration Count
Web Vite - AsyncComponent (10 runs) render Baseline
Mean: 41.4 ms
Stdev: 0.3 ms (0.7%)
Runs: 41.3 41.6 41.1 41.3 41.4 42.0 41.4 41.7 41.0 41.4
Warmup runs: 51.1

Current
Mean: 49.1 ms
Stdev: 1.2 ms (2.5%)
Runs: 48.7 52.5 48.9 48.5 48.5 48.8 49.2 48.2 48.6 49.0
Warmup runs: 65.1
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4
Render issues:

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5
Render issues:
- Initial updates: 1
Web Vite - AsyncComponent (50 runs) render Baseline
Mean: 41.6 ms
Stdev: 1.3 ms (3.2%)
Runs: 41.4 41.3 41.4 41.4 41.2 41.5 40.8 41.5 41.4 41.2 41.5 40.7 42.8 41.4 41.4 41.2 41.0 41.1 42.4 42.6 47.9 41.4 41.4 41.2 41.1 41.1 41.4 47.6 41.3 40.9 41.5 41.6 41.4 41.3 41.9 41.4 41.5 41.2 41.3 40.7 41.2 41.2 41.3 41.0 41.1 41.2 40.9 41.3 41.1 41.5
Warmup runs: 41.3

Current
Mean: 49.1 ms
Stdev: 1.2 ms (2.5%)
Runs: 48.7 48.7 48.5 49.0 48.8 48.9 49.3 48.4 48.7 48.3 48.8 48.8 48.6 48.4 48.8 49.2 49.1 48.8 50.6 48.9 48.6 51.1 48.8 48.7 48.4 48.6 49.6 48.6 49.5 48.2 49.0 48.6 49.0 48.7 48.7 48.6 49.1 48.9 50.3 48.9 48.4 48.3 48.4 48.7 48.7 48.7 49.1 50.8 56.4 49.1
Warmup runs: 48.9
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
Render issues:

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5
Render issues:
- Initial updates: 1
Web Vite - TestList (100 items) render Baseline
Mean: 10.7 ms
Stdev: 0.1 ms (1.1%)
Runs: 10.7 11.0 10.7 10.6 10.6 10.7 10.6 10.7 10.9 10.7
Warmup runs: 10.9

Current
Mean: 14.5 ms
Stdev: 0.7 ms (5.1%)
Runs: 14.6 16.2 15.6 14.2 14.2 14.2 14.0 14.1 14.1 14.3
Warmup runs: 15.0
Baseline
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1
Render issues:

Current
Mean: 2
Stdev: 0 (0.0%)
Runs: 2 2 2 2 2 2 2 2 2 2
Render issues:
- Initial updates: 1

Render Issues

Name Initial Updates Redundant Updates
Web Vite - AsyncComponent (10 runs) 1 🔴 -
Web Vite - AsyncComponent (50 runs) 1 🔴 -
Web Vite - TestList (100 items) 1 🔴 -

Added Entries

There are no entries

Removed Entries

There are no entries

Generated by 🚫 dangerJS against fc93e6a

@Victorvikson1996
Copy link

How can Use this

@mdjastrzebski
Copy link
Member Author

@Victorvikson1996 you can learn more about Reassure here: docs, GitHub.

@Victorvikson1996
Copy link

Thank you so much @mdjastrzebski

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants