A simple pytest plugin to run tests concurrently
This pytest plugin takes a set of tests that would be normally be run serially and execute them in parallel.
The main goal of pytest-run-parallel
is to discover thread-safety issues that
could exist when using C libraries, this is of vital importance after PEP703,
which provides a path for a CPython implementation without depending on the
Global Interpreter Lock (GIL), thus allowing for proper parallelism in programs
that make use of the CPython interpreter.
For more information about C thread-safety issues, please visit the free-threaded community guide at https://py-free-threading.github.io/
- A global CLI flag
--parallel-threads
to run a test suite in parallel - A marker
pytest.mark.parallel_threads
to mark a single test to run in parallel
pytest-run-parallel
depends exclusively on pytest
.
You can install "pytest-run-parallel" via pip from PyPI:
$ pip install pytest-run-parallel
This plugin has two modes of operation, one via the --parallel-threads
pytest
CLI flag, which allows a whole test suite to be run in parallel:
pytest --parallel-threads=10 tests
By default, the value of parallel-threads
will be 1, thus not modifying the
usual behaviour of pytest except when the flag is set.
The other mode of operation occurs at the individual test level, via the
pytest.mark.parallel_threads
marker:
# test_file.py
import pytest
@pytest.fixture
def my_fixture():
...
@pytest.mark.parallel_threads(2)
def test_something_1():
# This test will be run in parallel using two concurrent threads
...
@pytest.mark.parametrize('arg', [1, 2, 3])
@pytest.mark.parallel_threads(3)
def test_fixutre(my_fixture, arg):
# pytest markers and fixtures are supported as well
...
Both modes of operations are supported simultaneously, i.e.,
# test_something_1 and test_fixutre will be run using their set number of
# threads; other tests will be run using 5 threads.
pytest -x -v --parallel-threads=5 test_file.py
Contributions are very welcome. Tests can be run with tox, please ensure the coverage at least stays the same before you submit a pull request.
Distributed under the terms of the MIT license, "pytest-run-parallel" is free and open source software
If you encounter any problems, please file an issue along with a detailed description.