Parametrize test_benchmarks.py
test by criterion benchmarks
#4832
Labels
Good first issue
Indicates a good issue for first-time contributors
Priority: Low
Indicates that an issue or pull request should be resolved behind issues or pull requests labelled `
Status: Parked
Indicates that an issues or pull request will be revisited later
Currently,
test_benchmarks.py
contains a single test that runs all criterion benchmarks. With increasing number of benchmarks, we thus increase the duration of this test, and need to adjust its timeout. Instead, we want to parameterize the test by the list of criterion benchmarks we have in the repository. This means introducing a fixture that yields the benchmarks listed bycargo bench --all -- --list
individually. Then the test itself would only run the benchmark it is provided. This should also make it easier to see which benchmarks are failing.Originally posted by @pb8o in #4830 (comment)
The text was updated successfully, but these errors were encountered: