An open API service indexing awesome lists of open source software.

https://github.com/walles/mvn-testalot

Run "mvn test" multiple times and report slow / flaky tests
https://github.com/walles/mvn-testalot

flaky-tests maven performance testing-tools

Last synced: 2 months ago
JSON representation

Run "mvn test" multiple times and report slow / flaky tests

Awesome Lists containing this project

README

        

# mvn-testalot

Run `mvn test` multiple times and report on slow / flaky tests.

# Example commands

Run `mvn test` 10 times:
```
mvn-testalot.py 10
```

Analyze results:
```
mvn-testalot.py report
```

# Example output

Output is printed as human readable Markdown, for easy GitHub bug reporting.

# Slow tests

| Result | Duration | Name |
|--------|---------------|------|
| FAIL | 9.8s (0.6s) | `org.example.DemoTest.bar()` |
| FAIL | 9.2s (0.7s) | `org.example.DemoTest.foo()` |
| ok | 8.5s (0.2s) | `org.example.DemoTest.baz()` |

# Flaky tests

`.` = pass, `x` = fail, `E` = error

| Result | Name |
|--------|------|
| `....x....x` | `org.example.DemoTest.bar()` |
| `x....x....` | `org.example.DemoTest.foo()` |