[query] Benchmark configurations

[ehigham]

Change Description

Added benchmark parameters to all benchmark tests in the Hail codebase. Each test now specifies:

• Minimum detectable slowdown (mds)
• Number of instances (ie number of batch jobs)
• Number of iterations (how many timed trials of the benchmark per instance)
• Number of burn-in iterations (number of untimed trials run before timing)

These parameters allow for more precise and controlled benchmark measurements by explicitly defining the statistical requirements and execution parameters for each test.

Security Assessment

This change has no security impact

Impact Description

Low-level test configuration changes only - modifies benchmark test parameters without changing any functional code or test logic.

[ehigham]

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

• [query] Benchmark configurations #14762 👈 (View in Graphite)
• [benchmark] notebook for interactively computing benchmark config #14757
• [query] Various Benchmark Suite Improvements #14761
• [query] make local and remote tmp settable on backend #14748
• [query] Lowering + Optimisation with implict timing context #14731 : 2 other dependent PRs (#14732 , #14952 )
• [query] Lift backend state into (Batch|Py4J)QueryDriver #14698
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.