{"id":20081938,"url":"https://github.com/exercism/uiua-test-runner","last_synced_at":"2025-09-20T18:32:28.116Z","repository":{"id":262408511,"uuid":"887135318","full_name":"exercism/uiua-test-runner","owner":"exercism","description":null,"archived":false,"fork":false,"pushed_at":"2024-12-24T12:04:49.000Z","size":40,"stargazers_count":0,"open_issues_count":0,"forks_count":2,"subscribers_count":7,"default_branch":"main","last_synced_at":"2025-01-07T13:49:18.237Z","etag":null,"topics":["exercism-test-runner","exercism-tooling","maintained-autonomous"],"latest_commit_sha":null,"homepage":null,"language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/exercism.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":["exercism"],"custom":["https://exercism.org/donate"]}},"created_at":"2024-11-12T08:23:01.000Z","updated_at":"2024-12-24T12:04:53.000Z","dependencies_parsed_at":"2024-12-04T07:41:24.120Z","dependency_job_id":null,"html_url":"https://github.com/exercism/uiua-test-runner","commit_stats":null,"previous_names":["exercism/uiua-test-runner"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/exercism%2Fuiua-test-runner","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/exercism%2Fuiua-test-runner/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/exercism%2Fuiua-test-runner/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/exercism%2Fuiua-test-runner/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/exercism","download_url":"https://codeload.github.com/exercism/uiua-test-runner/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":233682433,"owners_count":18713551,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["exercism-test-runner","exercism-tooling","maintained-autonomous"],"created_at":"2024-11-13T15:41:01.038Z","updated_at":"2025-09-20T18:32:22.834Z","avatar_url":"https://github.com/exercism.png","language":"Shell","funding_links":["https://github.com/sponsors/exercism","https://exercism.org/donate"],"categories":[],"sub_categories":[],"readme":"# Exercism Uiua Test Runner\n\nThe Docker image to automatically run tests on Uiua solutions submitted to [Exercism].\n\n## Getting started\n\nBuild the test runner, conforming to the [Test Runner interface specification](https://github.com/exercism/docs/blob/main/building/tooling/test-runners/interface.md).\nUpdate the files to match your track's needs. At the very least, you'll need to update `bin/run.sh`, `Dockerfile` and the test solutions in the `tests` directory\n\n- Tip: look for `TODO:` comments to point you towards code that need updating\n- Tip: look for `OPTIONAL:` comments to point you towards code that _could_ be useful\n- Tip: if it proves impossible for the Docker image to work on a read-only filesystem, remove the `--read-only` flag from the `bin/run-in-docker.sh` and `bin/run-tests-in-docker.sh` files.\n  We don't yet enforce a read-only file system in production, but we might in the future!\n\n## Run the test runner\n\nTo run the tests of a single solution, do the following:\n\n1. Open a terminal in the project's root\n2. Run `./bin/run.sh \u003cexercise-slug\u003e \u003csolution-dir\u003e \u003coutput-dir\u003e`\n\nOnce the test runner has finished, its results will be written to `\u003coutput-dir\u003e/results.json`.\n\n## Run the test runner on a solution using Docker\n\n_This script is provided for testing purposes, as it mimics how test runners run in Exercism's production environment._\n\nTo run the tests of a single solution using the Docker image, do the following:\n\n1. Open a terminal in the project's root\n2. Run `./bin/run-in-docker.sh \u003cexercise-slug\u003e \u003csolution-dir\u003e \u003coutput-dir\u003e`\n\nOnce the test runner has finished, its results will be written to `\u003coutput-dir\u003e/results.json`.\n\n## Run the tests\n\nTo run the tests to verify the behavior of the test runner, do the following:\n\n1. Open a terminal in the project's root\n2. Run `./bin/run-tests.sh`\n\nThese are [golden tests][golden] that compare the `results.json` generated by running the current state of the code against the \"known good\" `tests/\u003ctest-name\u003e/expected_results.json`. All files created during the test run itself are discarded.\n\nWhen you've made modifications to the code that will result in a new \"golden\" state, you'll need to update the affected `tests/\u003ctest-name\u003e/expected_results.json` file(s).\n\n## Run the tests using Docker\n\n_This script is provided for testing purposes, as it mimics how test runners run in Exercism's production environment._\n\nTo run the tests to verify the behavior of the test runner using the Docker image, do the following:\n\n1. Open a terminal in the project's root\n2. Run `./bin/run-tests-in-docker.sh`\n\nThese are [golden tests][golden] that compare the `results.json` generated by running the current state of the code against the \"known good\" `tests/\u003ctest-name\u003e/expected_results.json`. All files created during the test run itself are discarded.\n\nWhen you've made modifications to the code that will result in a new \"golden\" state, you'll need to update the affected `tests/\u003ctest-name\u003e/expected_results.json` file(s).\n\n## Benchmarking\n\nThere are two scripts you can use to benchmark the test runner:\n\n1. `./bin/benchmark.sh`: benchmark the test runner code\n2. `./bin/benchmark-in-docker.sh`: benchmark the Docker image\n\nThese scripts can give a rough estimation of the test runner's performance.\nBear in mind though that the performance on Exercism's production servers is often lower.\n\n[test-runners]: https://github.com/exercism/docs/tree/main/building/tooling/test-runners\n[golden]: https://ro-che.info/articles/2017-12-04-golden-tests\n[exercism]: https://exercism.org\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fexercism%2Fuiua-test-runner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fexercism%2Fuiua-test-runner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fexercism%2Fuiua-test-runner/lists"}