[benchmark] notebook for interactively computing benchmark config#14757
Merged
Conversation
Member
Author
This stack of pull requests is managed by Graphite. Learn more about stacking. |
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
3 times, most recently
from
8d65393 to
39eb23a
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
39eb23a to
20ea9e5
Compare
ehigham
force-pushed
the
ehigham/tmpdir-per-query
branch
from
d5575e9 to
2543350
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
2 times, most recently
from
fd48477 to
5041735
Compare
ehigham
force-pushed
the
ehigham/tmpdir-per-query
branch
from
2543350 to
7965c8f
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
5041735 to
207fa9b
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
2 times, most recently
from
7ee594a to
e47b948
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
e47b948 to
df2624c
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
3 times, most recently
from
5828ffd to
d8e0986
Compare
ehigham
changed the base branch from
ehigham/tmpdir-per-query
to
ehigham/optimise-implicit-context
This was referenced Dec 5, 2024
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
1f1e53a to
25f887d
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
93eef37 to
3628ca4
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
25f887d to
2ca4759
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
3628ca4 to
0f30a45
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
2ca4759 to
d06c345
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
0f30a45 to
fcaeab8
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
d06c345 to
ea65b65
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
fcaeab8 to
ec5bad7
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
ea65b65 to
ae0b98a
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
ec5bad7 to
90d63d7
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
ae0b98a to
6a936ef
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
90d63d7 to
371d3e4
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
6a936ef to
720e155
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
371d3e4 to
bec9e1a
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
720e155 to
48b958f
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
bec9e1a to
46c48c3
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
48b958f to
6c02fa7
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
46c48c3 to
bf845f6
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
6c02fa7 to
4a43a71
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
bf845f6 to
5646493
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
4a43a71 to
48b9a81
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
5646493 to
0c9d568
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
48b9a81 to
0bff74d
Compare
ehigham
force-pushed
the
ehigham/benchmark-suite-improvements
branch
from
0c9d568 to
591a687
Compare
ehigham
force-pushed
the
ehigham/benchmark-in-batch-variability
branch
from
0bff74d to
10ca001
Compare
patrick-schultz
requested changes
Dec 15, 2025
Member
patrick-schultz
left a comment
patrick-schultz
left a comment
There was a problem hiding this comment.
Overall this is great! Just a couple small things.
patrick-schultz
approved these changes
Feb 27, 2026
Member
patrick-schultz
left a comment
patrick-schultz
left a comment
There was a problem hiding this comment.
Excellent, thanks for all the comments!
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Change Description
Adds tools for analyzing benchmark variability and detecting minimal slowdowns when running benchmarks on Hail Batch. The analysis is based on methods from Laaber et al.'s paper on software microbenchmarking in the cloud.
Key additions:
Security Assessment
This change has no security impact
Impact Description
Analysis and visualization code that operates on benchmark data only, with no access to sensitive information or systems.