https://github.com/Barski-lab/cwl-airflow

Python package to extend Airflow functionality with CWL1.1 support
https://github.com/Barski-lab/cwl-airflow

common-workflow-language commonwl containers cwl cwl-airflow cwl-descriptor dag workflow

Last synced: about 1 month ago
JSON representation

Python package to extend Airflow functionality with CWL1.1 support

• Host: GitHub
• URL: https://github.com/Barski-lab/cwl-airflow
• Owner: Barski-lab
• License: apache-2.0
• Created: 2017-09-11T23:14:12.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2023-10-25T17:36:40.000Z (11 months ago)
• Last Synced: 2024-07-27T17:56:44.459Z (about 2 months ago)
• Topics: common-workflow-language, commonwl, containers, cwl, cwl-airflow, cwl-descriptor, dag, workflow
• Language: Python
• Homepage: https://barski-lab.github.io/cwl-airflow
• Size: 2.77 MB
• Stars: 183
• Watchers: 7
• Forks: 33
• Open Issues: 16
• Metadata Files:
  • Readme: README.dev.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

        
## **Notes for developers**

When running on MacOS, you might need to set up the following env variable before starting `airflow scheduler/webserver`

```

export OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES

```

**Conformance and unit tests were run for**

- macOS 11.4

  - Python 3.8.6

- Ubuntu 18.04

  - Python 3.6.8

  - Python 3.7.9

  - Python 3.8.10

- Ubuntu 20.04

  - Python 3.6.8

  - Python 3.7.9

  - Python 3.8.10

*For Ubuntu the Python versions were selected based on latest available binary release at the time of testing.

**To run conformance tests in Docker container**

```

cd tests

./run_conformance_tests_docker.sh $UBUNTU_VERSION $PYTHON_VERSION $CWL_AIRFLOW_VERSION $REPO_URL $SUITE

```

**To run unit tests in Docker container**

```

cd tests

./run_unit_tests_docker.sh $UBUNTU_VERSION $PYTHON_VERSION $CWL_AIRFLOW_VERSION

```

**To build rellocatable version in Docker container**

```

cd ./packaging/portable/linux

./pack_linux_docker.sh

```