An open API service indexing awesome lists of open source software.

https://github.com/common-workflow-lab/run-conformance-tests

Action for running CWL conformance tests
https://github.com/common-workflow-lab/run-conformance-tests

common-workflow-language commonwl cwl

Last synced: 4 months ago
JSON representation

Action for running CWL conformance tests

Awesome Lists containing this project

README

          

# run-conformance-tests
It is a custom Github Action for running CWL conformance tests with a given CWL runner.

## Example

```yaml
jobs:
conformance:
runs-on: ubuntu-latest
steps:
# setup CWL runner
- uses: actions/checkout@v4
- name: Setup python for cwltool
uses: actions/setup-python@v5
with:
python-version: '3.12.x'
- name: Install cwltool
run: pip install cwltool
- uses: actions/setup-node@v4
with:
node-version: '20.x'

- name: Run conformance tests
id: run-conformance
uses: common-workflow-lab/run-conformance-tests@v1
with:
cwlVersion: v1.0
runner: cwltool
timeout: 30
skip-python-install: true

- name: Do something with badgedir
run: |
echo ${{ steps.run-conformance.outputs.badgedir }}
```

## Input parameters

| Parameters | Required | Default | Description |
|---|---|---|---|
| `cwlVersion` | true | - | target CWL version |
| `runner` | true | - | full path to CWL runner to be tested |
| `timeout` | false | 30 | timeout in seconds |
| `tags` | false | "" | tags to be tested (e.g., "docker,required") |
| `n` | false | "" | specify tests by their numbers (e.g., "1-5,10,13") |
| `s` | false | "" | specify tests by their names (e.g., "test_a,test_b") |
| `extra` | false | "" | extra arguments for the given CWL runner |
| `skip-python-install` | false | false | skip installing python interpreter |

The `skip-python-install` parameter is useful when CWL runner requires specific version of Python.

## Output parameters

| Parameters | Description |
|---|---|
| `badgedir` | directory name that stores conformance badges |
| `result` | file name that stores the result of conformance tests in JUnit XMl format |