Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/luttik/pytest-locker

The fastest way to check for unexpected changes between test runs.
https://github.com/luttik/pytest-locker

pytest pytest-fixtures python testing

Last synced: about 1 month ago
JSON representation

The fastest way to check for unexpected changes between test runs.

Awesome Lists containing this project

README

        

# PyTest-Locker

Example


PyTest-Locker: The fastest way to check for unexpected changes between test runs



actions batch


pypi


python versions


codecov


License: MIT


Code style: black

## The general concept
In essense Pytest-Locker changes the basis of testing from having to assert everything that is relevant about an object
to only having to assert that an object should not change unexpectedly (i.e. the object is locked).

This, of course, implies that the pytest-locker approach makes a lot of sense
when the assertion logic becomes complex. I found it especially handy when testing if I'm sending the right API calls.

Since objects can be just about anything in python
(output, state, or even function calls via [mocking](https://docs.python.org/3/library/unittest.mock.html))
you can use this approach for just about everything.

Since you need to validate if the object to lock is correct, both in the first run and after desired modifications,
the test flow is slightly different:

pytest-locker's flow diagram

## Why use PyTest-Locker

- Time efficient: No need to hard code expected responses. (Especially usefull for data heavy unittests)
- Easy to verify changes:

- Seperates the logic of the test from the expected values.
- The lock files (containing the expected values), and changes to them, are easy to interpret. This makes it really
simple to evaluate changes during testing, in commits and in pull request.

## Install

run `pip install pytest-locker`

## Usage

### Configuring the project and writing your first test.

1. Add `from pytest_locker import locker` to your
[conftest.py](https://docs.pytest.org/en/2.7.3/plugins.html?highlight=re)
file
2. To access the locker by adding it to the method parameters i.e. `def test_example(locker)`

[comment]: <> (Also write todo for non-string types.)

4. Use `locker.lock(your_string, optional_name)` to lock the data (of-course you can also lock other types).
5. Ensure that the [pytest rootdir](https://docs.pytest.org/en/latest/customize.html) is fixed.
See [the pytest customize documentation](https://docs.pytest.org/en/latest/customize.html) for all the options (one
is adding a `pytest.ini` to the root folder)
6. Ensure that `.pytest_locker/` is synced via git, to ensure that you, your team, and your CI/CD pipelines are working
with the same data.

And you're all set!

### Accepting the current behavior and checking fo changes in this behavior

There are two modes based on for locking. The first is

1. When user input is allowed, i.e. when running pytest with
`--capture no` or `-s`

When user input is allowed and the given data does not correspond to the data in the lock the *user is prompted* if
the new data should be stored or if the tests should fail.

2. When user input is captured which is default behavior for pytest

If user input is not allowed the tests will *automatically fail* if the expected lock file does not exist or if the
data does not correspond to the data in the lock file.

## The Locker class

You can also use `pytest_locker.Locker` (i.e. the class of which the
`locker` fixture returns an instance) directly to create fixtures that locks a (non-string) object without needing to
turn the object into a string it.

## Examples

For example of use look at the tests in
[repr-utils](https://github.com/Luttik/repr-utils).