Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/wiktor-k/testresult

Provides TestResult type for concise and precise test failures
https://github.com/wiktor-k/testresult

rust testing

Last synced: 6 days ago
JSON representation

Provides TestResult type for concise and precise test failures

Awesome Lists containing this project

README

        

# Test result

[![CI](https://github.com/wiktor-k/testresult/actions/workflows/rust.yml/badge.svg)](https://github.com/wiktor-k/testresult/actions/workflows/rust.yml)
[![Crates.io](https://img.shields.io/crates/v/testresult)](https://crates.io/crates/testresult)
[![Codecov](https://img.shields.io/codecov/c/gh/wiktor-k/testresult)](https://app.codecov.io/gh/wiktor-k/testresult)

Provides `TestResult` type that can be used in tests to avoid
`unwrap`s but at the same time to have precise stacktraces with the
point of failure clearly written.

It's like a lean [`anyhow`](https://crates.io/crates/anyhow) for tests!

## Details

Consider the following code. It uses `unwrap` so the test failure
stacktrace will informative. Unfortunately it's not as concise as it
could be:

```rust
#[test]
fn it_works() {
// ...
std::fs::File::open("this-file-does-not-exist").unwrap();
// ...
}
```

Improved version of this code uses `Result` and the `?` operator:

```rust
#[test]
fn it_works() -> Result<(), Box> {
// ...
std::fs::File::open("this-file-does-not-exist")?;
// ...
Ok(())
}
```

Running the following code with `RUST_BACKTRACE=1 cargo test` shows
the following stacktrace:

```text
---- tests::it_works stdout ----
thread 'tests::it_works' panicked at 'assertion failed: `(left == right)`
left: `1`,
...
4: test::assert_test_result
at /rustc/4b91a6ea7258a947e59c6522cd5898e7c0a6a88f/library/test/src/lib.rs:184:5
5: testresult::tests::it_works::{{closure}}
at ./src/lib.rs:52:5
6: core::ops::function::FnOnce::call_once
at /rustc/4b91a6ea7258a947e59c6522cd5898e7c0a6a88f/library/core/src/ops/function.rs:248:5
...
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
```

Unfortunately even though the test function location is recorded, the
exact line where the test failure occurred is not present in the
backtrace.

Let's adjust the test result type to use `TestResult`. This is the
only change compared to previous example:

```rust
#[test]
fn it_works() -> TestResult {
// ...
std::fs::File::open("this-file-does-not-exist")?;
// ...
Ok(())
}
```

Running it again with `cargo test` shows more details:

```text
---- tests::it_works stdout ----
thread 'tests::it_works' panicked at 'error: std::io::error::Error - No such file or directory (os error 2)', src/lib.rs:53:9
```

Note that the error location is now in the backtrace and also in the test failure message. This means that we don't
even need the backtrace to know where the error happened.

The advantages of using `TestResult`:
- exact failure line is present in the test failure and the backtrace,
- the underlying error type and message are present in the test failure,
- the signature of the test result is simpler.

For a more elaborate description see ["Improving failure messages in Rust tests returning a Result"][IMPROV].

[IMPROV]: https://bluxte.net/musings/2023/01/08/improving_failure_messages_rust_tests/

## License

This project is licensed under either of:

- [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0),
- [MIT license](https://opensource.org/licenses/MIT).

at your option.

### Contribution

Unless you explicitly state otherwise, any contribution intentionally
submitted for inclusion in this crate by you, as defined in the
Apache-2.0 license, shall be dual licensed as above, without any
additional terms or conditions.