pytest-dev/pytest-order pytest-dev/pytest-order

  • Stars
    star
    158
  • Rank 237,131 (Top 5 %)
  • Language
    Python
  • License
    Other
  • Created about 4 years ago
  • Updated 4 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
pytest-dev/pytest-order
github

pytest-dev

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

pytest plugin that allows to customize the test execution order

pytest-order - a pytest plugin to order test execution

PyPI version Testsuite DocBuild codecov Python version

pytest-order is a pytest plugin that allows you to customize the order in which your tests are run. It uses the marker order that defines when a specific test shall run, either by using an ordinal number, or by specifying the relationship to other tests.

pytest-order is a fork of pytest-ordering that provides additional features like ordering relative to other tests.

pytest-order works with Python 3.7 - 3.11, with pytest versions >= 5.0.0 for all versions up to Python 3.9, and for pytest >= 6.2.4 for Python 3.10 and 3.11. pytest-order runs on Linux, macOS and Windows.

Documentation

Apart from this overview, the following information is available:

Features

pytest-order provides the following features:

  • ordering of tests by index
  • ordering of tests both from the start and from the end (via negative index)
  • ordering of tests relative to each other (via the before and after marker attributes)
  • session-, module- and class-scope ordering via the order-scope option
  • directory scope ordering via the order-scope-level option
  • hierarchical module and class-level ordering via the order-group-scope option
  • ordering tests with pytest-dependency markers if using the order-dependencies option, more information about pytest-dependency compatibility here
  • sparse ordering of tests via the sparse-ordering option

Overview

(adapted from the original project)

Have you ever wanted to easily run one of your tests before any others run? Or run some tests last? Or run this one test before that other test? Or make sure that this group of tests runs after this other group of tests?

Now you can.

Install with:

pip install pytest-order

This defines the order marker that you can use in your code with different attributes.

For example, this code:

import pytest

@pytest.mark.order(2)
def test_foo():
    assert True

@pytest.mark.order(1)
def test_bar():
    assert True

yields the output:

$ pytest test_foo.py -vv
============================= test session starts ==============================
platform darwin -- Python 3.7.1, pytest-5.4.3, py-1.8.1, pluggy-0.13.1 -- env/bin/python
plugins: order
collected 2 items

test_foo.py:7: test_bar PASSED
test_foo.py:3: test_foo PASSED

=========================== 2 passed in 0.01 seconds ===========================

Contributing

Contributions are very welcome. Tests can be run with tox, please ensure the coverage at least stays the same before you submit a pull request.

License

Distributed under the terms of the MIT license, pytest-order is free and open source software.

History

This is a fork of pytest-ordering. That project is not maintained anymore, and there are several helpful PRs that are now integrated into pytest-order. The idea and most of the initial code has been created by Frank Tobia, the author of that plugin, and contributors.

While derived from pytest_ordering, pytest-order is not compatible with pytest-ordering due to the changed marker name (order instead of run). Additional markers defined pytest_ordering are all integrated into the order marker (for a rationale see also this issue).

Ordering relative to other tests and all the configuration options are not available in the released version of pytest-ordering. However, most of these features are derived from or inspired by issues and pull requests already existing in pytest-ordering.

More Repositories

1

pytest

The pytest framework makes it easy to write small tests, yet scales to support complex functional testing
Python
11,750
star
2

pytest-testinfra

Testinfra test your infrastructures
Python
2,359
star
3

pytest-mock

Thin-wrapper around the mock package for easier use with pytest
Python
1,804
star
4

pytest-cov

Coverage plugin for pytest.
Python
1,722
star
5

pytest-xdist

pytest plugin for distributed testing and loop-on-failures testing modes.
Python
1,421
star
6

pytest-asyncio

Asyncio support for pytest
Python
1,378
star
7

pytest-django

A Django plugin for pytest.
Python
1,350
star
8

pytest-bdd

BDD library for the py.test runner
Python
1,281
star
9

pluggy

A minimalist production ready plugin system
Python
1,235
star
10

pytest-html

Plugin for generating HTML reports for pytest results
Python
689
star
11

pyfakefs

Provides a fake file system that mocks the Python file system modules.
Python
635
star
12

pytest-randomly

🎲 Pytest plugin to randomly order tests and control random.seed
Python
600
star
13

pytest-flask

A set of pytest fixtures to test Flask applications
Python
483
star
14

pytest-qt

pytest plugin for Qt (PyQt5/PyQt6 and PySide2/PySide6) application testing
Python
401
star
15

pytest-rerunfailures

a pytest plugin that re-runs failed tests up to -n times to eliminate flakey failures
Python
373
star
16

pytest-factoryboy

factory_boy integration the pytest runner
Python
358
star
17

pytest-selenium

Plugin for running Selenium with pytest
Python
331
star
18

cookiecutter-pytest-plugin

A Cookiecutter template for pytest plugins πŸ’»
Python
292
star
19

pytest-splinter

pytest splinter and selenium integration for anyone interested in browser interaction in tests
Python
253
star
20

pytest-describe

Describe-style plugin for the pytest framework
Python
208
star
21

pytest-timeout

Python
206
star
22

pytest-subtests

unittest subTest() support and subtests fixture
Python
199
star
23

pytest-repeat

pytest plugin for repeating test execution
Python
168
star
24

pytest-instafail

py.test plugin to show failures instantly
Python
135
star
25

unittest2pytest

helps rewriting Python `unittest` test-cases into `pytest` test-cases
Python
128
star
26

pytest-env

pytest plugin to set environment variables in pytest.ini or pyproject.toml file
Python
128
star
27

pytest-github-actions-annotate-failures

Pytest plugin to annotate failed tests with a workflow command for GitHub Actions
Python
127
star
28

pytest-cpp

Use pytest's runner to discover and execute C++ tests
C++
117
star
29

pytest-xprocess

pytest external process plugin
Python
97
star
30

pytest-reportlog

Replacement for the --resultlog option, focused in simplicity and extensibility
Python
89
star
31

execnet

distributed Python deployment and communication
Python
78
star
32

pytest-variables

Plugin for providing variables to pytest tests/fixtures
Python
74
star
33

pytest-play

pytest plugin that let you automate actions and assertions with test metrics reporting executing plain YAML files
Python
68
star
34

py

Python development support library (note: maintenance only)
Python
67
star
35

pytest-print

pytest-print adds the printer fixture you can use to print messages to the user (directly to the pytest runner, not stdout)
Python
67
star
36

pytest-messenger

Pytest-messenger report plugin for all popular messengers like: Slack, DingTalk, Telegram
Python
67
star
37

pytest-random-order

pytest plugin to randomise the order of tests with some control over the randomness
Python
65
star
38

pytest-forked

extracted --boxed from pytest-xdist to ensure backward compat
Python
62
star
39

pytest-mimesis

Mimesis integration with the pytest test runner. This plugin provider useful fixtures based on providers from Mimesis.
Python
62
star
40

pytest-services

Collection of fixtures and utility functions to run service processes for your tests
Python
57
star
41

pytest-runner

Python
56
star
42

pytest-metadata

Plugin for accessing test session metadata
Python
56
star
43

apipkg

Python
55
star
44

iniconfig

Python
50
star
45

pytest-twisted

test twisted code with pytest
Python
46
star
46

pytest-freezer

Pytest plugin providing a fixture interface for spulec/freezegun
Python
45
star
47

pytest-incremental

py-test plugin: an incremental test runner
Python
42
star
48

pytest-stress

A Pytest plugin that allows you to loop tests for a user defined amount of time.
Python
41
star
49

nose2pytest

Scripts to convert Python Nose tests to PyTest
Python
38
star
50

pytest-base-url

pytest plugin for URL based tests
Python
38
star
51

pytest-faker

faker integration the pytest test runner
Python
38
star
52

pytest-fixture-tools

Pytest fixture tools
Python
36
star
53

pytest-cloud

Distributed tests planner plugin for pytest testing framework.
Python
35
star
54

plugincompat

Test execution and compatibility checks for pytest plugins
CSS
34
star
55

pytest-faulthandler

py.test plugin that activates the fault handler module during testing
Python
27
star
56

pytest-localserver

py.test plugin to test server connections locally. This repository was migrated from Bitbucket.
Python
23
star
57

pygments-pytest

A pygments lexer for pytest output
Python
23
star
58

pytest-echo

pytest plugin to dump environment variables, package version and generic attributes.
Python
22
star
59

pytest-inline

pytest-inline is a pytest plugin for writing inline tests.
Python
16
star
60

pytest-nunit

An Nunit output plugin for Pytest
Python
10
star
61

pytest-plus

pytest-plus adds new features to pytest
Python
10
star
62

design

Graphic design for Pytest project
9
star
63

pytest-iam

A fully functional OAUTH2 / OpenID Connect (OIDC) server to be used in your testsuite
Python
7
star
64

sprint

pytest development sprint 2024
7
star
65

pytest-bpdb

pytest plugin for dropping to bpdb on test failures
Python
6
star
66

blog.pytest.org

Repository for the official pytest blog
Python
4
star
67

pytest-tcpclient

pytest mocking of TCP clients
Python
3
star
68

regendoc

Python
2
star
69

meta

Used for generic pytest organization issues, stuff that can impact multiple projects.
2
star
70

pytest-libfaketime

Prepare pytest for python-libfaketime - https://github.com/simon-weber/python-libfaketime
Python
2
star
71

pytest-talks

public pytest talks and workshops - meant to help user groups spin up talks and workshops
HTML
1
star