https://github.com/codezeilen/rosetta-test
Write and use test suites across projects in different programming languages.
https://github.com/codezeilen/rosetta-test
automated-testing conformance-suite test-framework test-suites testing
Last synced: 11 days ago
JSON representation
Write and use test suites across projects in different programming languages.
- Host: GitHub
- URL: https://github.com/codezeilen/rosetta-test
- Owner: codeZeilen
- License: mit
- Created: 2024-07-15T19:20:19.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-05-23T13:04:18.000Z (10 months ago)
- Last Synced: 2025-09-07T07:03:10.196Z (6 months ago)
- Topics: automated-testing, conformance-suite, test-framework, test-suites, testing
- Language: Scheme
- Homepage:
- Size: 729 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# RosettaTest
[](https://github.com/codeZeilen/rosetta-test/actions/workflows/interpreter-tests.yml)
[](https://github.com/codeZeilen/rosetta-test/actions/workflows/python-suites.yml)
[](https://github.com/codeZeilen/rosetta-test/actions/workflows/ruby-suites.yml)
[](https://github.com/codeZeilen/rosetta-test/actions/workflows/javascript-suites.yml)
With the RosettaTest project, you only have to write a test suite once for multiple implementations.
(This is still a prototype project. Expect major architectural or API changes, as well as major bugs and inconsistencies.)
## Trying it out
Currently, the best-supported language is Python. To get an idea of how to create and port RosettaTest suites, try the Python version of the SMTP test suite, which runs against the SMTP implementation in the Python standard library.
You can run the SMTP test suite in Python by executing:
```Python
python3 rosetta-test-py/smtp.py
```
This will run the test suite from `/rosetta-test-suites/smtp.rosetta` using the mappings in `/rosetta-test-py/smtp.py`.
## Structure of the Repository
- The core RosettaTest language (`/rosetta-test`)
- RosettaTest language interpreters for
- Python (`/rosetta-test-py`)
- Ruby (`/rosetta-test-rb`)
- JavaScript (`/rosetta-test-js`)
- Smalltalk (`/rosetta-test-s`)
- A full test suite (`/rosetta-test-suites`) for
- SMTP (`smtp.rosetta`)
- RFC JSON parsing (`json-rfc.rosetta`)
- Prototype test suites (`/rosetta-test-suites`) for
- sending MIME documents (`sendmail.rosetta`)
- RFC URI parsing (`url-parsing-rfc.rosetta`)
## How it Works (Overview)
The test suites are written in the RosettaTest language. The parts that are implementation-specific are designated as _placeholders_. For every implementation that you want to test, you need to fill in these placeholders.
Thus, if you want to execute a RosettaTest suite for your project, you need:
1. A _RosettaTest language interpreter_ for your language
2. A _mapping_ that fills each placeholder with a function from the implementation. Often the mapping will not be 1:1, so you might need to write additional code to map the behavior to the expected behavior of the placeholder.
## Acknowledgements
- Syntax tests based on the corpus from [tree-sitter-scheme](https://github.com/6cdh/tree-sitter-scheme)
- JSON-RFC Suite tests are based on the [JSONTestSuite](https://github.com/nst/JSONTestSuite)
## Identified Defects and Implemented Improvements
- https://github.com/Miksus/red-mail/pull/96 (proposed)
- https://github.com/lavr/python-emails/pull/173 (proposed)
- https://github.com/python/cpython/pull/132797 (proposed)
- [Squeak/Smalltalk SMTPClient Patch](http://lists.squeakfoundation.org/archives/list/squeak-dev@lists.squeakfoundation.org/message/7DI6KAGWZBRNJCZ4HIM7S2QY5A3L4OO3/) (merged)