Go through every one-off setting to see which affects performance or correctness.
Data to record
- Run time
- Solution size
- FSAP count
- Wall-clock time
- Weak plan calls
Analysis to report
- IPC metric for all data (aside from FSAP count)
- Coverage
- Error count