https://github.com/koorosh/odh-workflows

https://github.com/koorosh/odh-workflows

Last synced: 20 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/koorosh/odh-workflows
• Owner: koorosh
• Created: 2021-03-07T21:22:15.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2021-03-13T18:12:28.000Z (almost 4 years ago)
• Last Synced: 2024-10-27T17:37:23.728Z (2 months ago)
• Language: Python
• Size: 6.84 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# odh-workflows

### How to setup local dev environment

- install `python 3.8` with `pyenv`

  ```shell

  pyenv install -v 3.8.2

  ```

- install `pip` and `virtualenv venv`

    ```shell

    python3 -m pip install --user --upgrade pip

    python3 -m pip install --user virtualenv

    ```

- create virtual env inside of `/venv` dir and activate environment

    ```shell

    # specify your own path 

    virtualenv -p ~/.pyenv/versions/3.8.2/bin/python3 venv

    source ./env/bin/activate

    ```

- install local dependencies

    ```shell

    pip install --trusted-host pypi.python.org "apache-airflow[postgres,apache.spark,microsoft.azure,ssh]==2.0.1" --constraint https://raw.githubusercontent.com/apache/airflow/constraints-2.0.1/constraints-3.8.txt

    pip install -r airflow.requirements.txt -r local.requirements.txt

    ```

### How to deactivate python env

  ```shell

  deactivate

  ```

### How to deploy to production (TBD)