Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ligurio/testres-db
is a tool to import test results into SQLite database
https://github.com/ligurio/testres-db
ci continuous-integration quality-assurance quality-metrics software-testing software-testing-tools test-automation testing testres-db
Last synced: 3 months ago
JSON representation
is a tool to import test results into SQLite database
- Host: GitHub
- URL: https://github.com/ligurio/testres-db
- Owner: ligurio
- License: mit
- Created: 2020-01-27T08:12:01.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2022-08-02T13:23:01.000Z (over 2 years ago)
- Last Synced: 2024-06-20T12:03:57.332Z (7 months ago)
- Topics: ci, continuous-integration, quality-assurance, quality-metrics, software-testing, software-testing-tools, test-automation, testing, testres-db
- Language: Go
- Homepage:
- Size: 2.89 MB
- Stars: 7
- Watchers: 3
- Forks: 1
- Open Issues: 28
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# testres-db
is a tool and library to import test results to a single SQLite database
for further analysis your efficiency of testing, find bottlenecks,
improve test execution and get better vizualization of a testing
process in your project.
You might consider using one of these three tools:
- [Command Line Shell For SQLite](https://sqlite.org/cli.html)
- [Datasette](https://datasette.io/)
- [The Jupyter Notebook](https://jupyter.org/)
Below there are some examples of queries:
```sql
~$ sqlite testres-db.sqlite
SQLite version 2.8.17
Enter ".help" for instructions
sqlite> SELECT * FROM testrun TR JOIN test T ON TR.test_id = T.test_id JOIN status ST ON TR.status_id = ST.status_id WHERE ST.name = 'PASSED';
sqlite> SELECT * FROM testrun TR JOIN test T ON TR.test_id = T.test_id JOIN suite S ON T.suite_id = S.suite_id JOIN report R ON TR.report_id = R.report_id JOIN status ST ON TR.status_id = ST.status_id WHERE ST.name = 'PASSED';
```
## Building
```
$ go get ./...
$ go test -v ./...
$ go build ./...
```
## How-To Use
There is a way to obtain test results from continuous integration services and
test results systems. Unfortunately not all such systems supports such ability.
First of all you should make sure test reports is available after every build
on continuous integration. For example GitLab CI
[allows](https://docs.gitlab.com/ee/ci/junit_test_reports.html) to store JUnit
reports as artifacts when Travis CI is not.
Secondly you should describe configuration file in YAML format which contains
information about your project.
```yaml
projects:
- name: criu
backends:
- type: jenkins
branch: master
pipeline: ""
base: https://ci.openvz.org/
username: anonymous
secret: anonymous
```
By default `testres-db` uses `testres-db.yaml` as a configuration file and
`testres.sqlite` as an SQLite database file. You can change default values
using command-line options.
```sh
$ testres-db -init -db testres.sqlite
$ testres-db -import -db testres.sqlite -config testres-db.yaml
```
## Supported backends
### Azure DevOps
Generate access token in
[profile](https://docs.microsoft.com/en-us/azure/devops/organizations/accounts/use-personal-access-tokens-to-authenticate?view=azure-devops&tabs=preview-page).
### Circle CI
Circle CI
[supports](https://circleci.com/docs/2.0/configuration-reference/#store_test_results)
storing test results in two formats: JUnit XML and Cucumber JSON. Access token
is not required to query info for public projects, to access to a private
projects follow steps in
[documentation](https://circleci.com/docs/api/#add-an-api-token) to obtain API
token.
Example of configuration file for [Helios project](https://github.com/spotify/helios):
```yaml
projects:
- name: helios
backends:
- type: circleci
branch: master
base: https://circleci.com/
project: spotify/helios
username:
secret:
```
### Cirrus CI
Cirrus CI allows to [store test report
files](https://cirrus-ci.org/guide/writing-tasks/#artifacts-instruction) in
JUnit formats. Access to Cirrus CI API may require access token. You can
generate it in [profile](https://cirrus-ci.com/settings/profile/).
Note: by default [Cirrus CI persists caches and logs for 90 days](https://cirrus-ci.org/faq/).
### GitLab
Gitlab supports publishing JUnit reports. Follow [instructions in
documentation](https://docs.gitlab.com/ee/ci/junit_test_reports.html) to setup
it up. In general case to enable the JUnit reports in merge requests, you need
to add `artifacts:reports:junit` in `.gitlab-ci.yml`, and specify the path(s)
of the generated test reports. Access to Gitlab API may require access token
with `api` capability. To generate access token please refer to
[documentation](https://docs.gitlab.com/ee/user/profile/personal_access_tokens.html).
`expire_in`
[allows](https://docs.gitlab.com/ce/ci/yaml/README.html#artifactsexpire_in) you
to specify how long artifacts should live before they expire and therefore
deleted, counting from the time they are uploaded and stored on GitLab. If the
expiry time is not defined, it defaults to the instance wide setting (30 days
by default, forever on GitLab.com).
Example of configuration file for a [Gitlab project](https://gitlab.com/ligurio/test-project):
```yaml
projects:
- name: test-project
backends:
- type: gitlab
branch: master
base: https://gitlab.com/
project: ligurio/test-project
username:
secret:
```
### Jenkins
Jenkins supports publishing test results in JUnit format, but not all Jenkins
instances supports it. To check this you may point your browser to a link
`/job//lastCompletedBuild/testReport/api/xml`. Browser
will show XML document in case of success. Access to Jenkins API may require
access token, please refer to
[documentation](https://jenkins.io/doc/book/using/using-credentials/) to obtain
it.
## See also
- [resultsdb](https://github.com/release-engineering/resultsdb)
- [TestArchiver](https://github.com/salabs/TestArchiver) - tools for
serialising test results to SQL database.
- [testmine](https://github.com/bbc/testmine) - test result aggregator and
analysis tool.
- [res](https://github.com/bbc/res) - intermediate representation for test
results.
## Contribution
There are numerous awesome [Continuous Integration
services](https://github.com/ligurio/awesome-ci) which are not integrated with
`testres-db`. Feel free to make a patches and bring support for them.
## Authors
Developed with passion by [Sergey Bronnikov](https://bronevichok.ru/) and great
open source [contributors](https://github.com/ligurio/testres-db/contributors).