https://github.com/ducthienbui97/queryintegrity
A framework to create and run tests on software using Metamorphic Testing
https://github.com/ducthienbui97/queryintegrity
Last synced: 24 days ago
JSON representation
A framework to create and run tests on software using Metamorphic Testing
- Host: GitHub
- URL: https://github.com/ducthienbui97/queryintegrity
- Owner: ducthienbui97
- License: mit
- Created: 2020-05-01T04:29:08.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2023-06-14T22:31:33.000Z (almost 2 years ago)
- Last Synced: 2025-02-07T22:52:46.343Z (3 months ago)
- Language: Java
- Homepage:
- Size: 69.3 KB
- Stars: 0
- Watchers: 3
- Forks: 1
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Query Integrity
Query Integrity is framework to create and run tests on software using [Metamorphic Testing](https://en.wikipedia.org/wiki/Metamorphic_testing).
The main purpose of the tool is to automatically test and find inconsistency of data query result in order to find bugs
and problems in data retrieving related features of software.
This library is originally developed for CSIT314's group assessment at University of Wollongong
## The idea
In any data retrieving system, the relation between the result of any 2 queries should be logically corrected
(e.g. A search for "A" should not return any result from a search for "not A").
These relations are metamorphic relations.
Failing to produce a correct relation between some pair of queries can be a result of:
- A bug
- A technical limitation
- A shortcoming of system design
- ...
These problems might not appear in development or even in testing due to small size of test data, deterministic natural
of manually created tests. We only test what we know can go wrong, but the bugs are normally found where we did not know
that can go wrong.
A simple solution for that is to automatically generate multiple pairs of queries that we know what relation of their
results should be. Hundreds or thousands of queries can be sent and validate without the creator know what query it is
or what is the supposed answer for that query.
## The tests
This project currently supports 3 kinds of metamorphic relations that are common among data retrieving systems:
### The `not` test
A query search for `A` should not return any result in the query search for `not A`.
### The `subset` test
- A query search for `A` should return all the result in the query search for `A and B`.
- A query search for `A or B` should return all the result in the query search for `A`.
### The `equal` test
- A query search for `A` should return the same result as a query search for `B` if A and B are logically equivalent
(e.g. `A` and `not not A`, `A and B` and `B and A`, ...)
## The project
This project provide following modules:
- [query-integrity-core](/query-integrity-core) provides testing service as well as interfaces to generate queries that
fit your system as well as a validator for the results.
- [mongodb-integration](/mongodb-integration) provides an implementation to test mongodb server.