@@ -209,17 +209,19 @@ one expression (not several), and there is no special setup argument
209209like atime (which means that the timing must include data setup code
210210which may be irrelevant).
211211
212- | | Language | Users | Github workflow result display | Comparative benchmarking | Performance testing |
213- |-------------------+-----------------------------+--------------------------------+--------------------------+---------------------|
214- | [[https://github.com/r-lib/bench][bench]] | R | | - | yes | - |
215- | [[https://www.rdocumentation.org/packages/microbenchmark/versions/1.5.0/topics/microbenchmark][microbenchmark]] | R | - | yes | - |
216- | [[https://stat.ethz.ch/R-manual/R-devel/library/base/html/system.time.html][system.time]] | R | | - | yes | - |
217- | [[https://github.com/cran/rbenchmark][rbenchmark]] | R | | - | yes | - |
218- | [[https://github.com/airspeed-velocity/asv][airspeed velocity]] | Python | numpy | [[https://pv.github.io/numpy-bench/][web page]] | - | yes |
219- | [[https://github.com/conbench/conbench][conbench]] | any | arrow | [[https://conbench.ursa.dev/][Arrow Conbench]] | - | yes |
220- | [[https://github.com/lorenzwalthert/touchstone][touchstone]] | R | | [[https://github.com/lorenzwalthert/touchstone/blob/main/man/figures/screenshot-pr-comment.png][PR comments]] | - | yes |
221- | [[https://github.com/ionelmc/pytest-benchmark][pytest-benchmark]] | Python | | [[https://github.com/ionelmc/pytest-benchmark#screenshots][web page]] | - | yes |
222- | [[https://github.com/tdhock/atime][atime (proposed)]] | R | data.table | [[https://github.com/Rdatatable/data.table/pull/5427#issuecomment-2075471806][PR comments]] | yes | yes |
212+ | | Language | Users | Github workflow result display | Comparative benchmarking | Performance testing |
213+ |-------------------+----------+------------+--------------------------------+--------------------------+---------------------|
214+ | [[https://github.com/tdhock/atime][atime (proposed)]] | R | data.table | [[https://github.com/Rdatatable/data.table/pull/5427#issuecomment-2075471806][PR comments]] | yes | yes |
215+ |-------------------+----------+------------+--------------------------------+--------------------------+---------------------|
216+ | [[https://github.com/r-lib/bench][bench]] | R | | - | yes | - |
217+ | [[https://www.rdocumentation.org/packages/microbenchmark/versions/1.5.0/topics/microbenchmark][microbenchmark]] | R | | - | yes | - |
218+ | [[https://stat.ethz.ch/R-manual/R-devel/library/base/html/system.time.html][system.time]] | R | | - | yes | - |
219+ | [[https://github.com/cran/rbenchmark][rbenchmark]] | R | | - | yes | - |
220+ |-------------------+----------+------------+--------------------------------+--------------------------+---------------------|
221+ | [[https://github.com/airspeed-velocity/asv][airspeed velocity]] | Python | numpy | [[https://pv.github.io/numpy-bench/][web page]] | - | yes |
222+ | [[https://github.com/conbench/conbench][conbench]] | any | arrow | [[https://conbench.ursa.dev/][web page]] | - | yes |
223+ | [[https://github.com/lorenzwalthert/touchstone][touchstone]] | R | | [[https://github.com/lorenzwalthert/touchstone/blob/main/man/figures/screenshot-pr-comment.png][PR comments]] | - | yes |
224+ | [[https://github.com/ionelmc/pytest-benchmark][pytest-benchmark]] | Python | | [[https://github.com/ionelmc/pytest-benchmark#screenshots][web page]] | - | yes |
223225
224226See [[https://bencher.dev/docs/reference/prior-art/][Bencher prior art]] for even more related work, and see [[https://bencher.dev/docs/explanation/continuous-benchmarking/][continuous
225227benchmarking]] for a plot that shows how false positives can show up if
0 commit comments