{"id":23331100,"url":"https://github.com/sassoftware/sas-airflow-provider","last_synced_at":"2025-04-09T12:09:22.697Z","repository":{"id":65210234,"uuid":"587887359","full_name":"sassoftware/sas-airflow-provider","owner":"sassoftware","description":"Apache Airflow Provider for creating tasks in Airflow to execute SAS Studio Flows and Jobs.","archived":false,"fork":false,"pushed_at":"2025-02-12T19:03:08.000Z","size":90,"stargazers_count":19,"open_issues_count":10,"forks_count":16,"subscribers_count":8,"default_branch":"main","last_synced_at":"2025-04-02T09:07:38.554Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sassoftware.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":"SUPPORT.md","governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-01-11T20:26:19.000Z","updated_at":"2025-02-12T19:03:13.000Z","dependencies_parsed_at":"2023-02-14T17:45:36.625Z","dependency_job_id":"089f7ad1-43aa-4e2b-bffe-db1ffefad46f","html_url":"https://github.com/sassoftware/sas-airflow-provider","commit_stats":{"total_commits":7,"total_committers":3,"mean_commits":"2.3333333333333335","dds":0.2857142857142857,"last_synced_commit":"928d9bf8a8104420675c4bd8613863a548395208"},"previous_names":[],"tags_count":21,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sassoftware%2Fsas-airflow-provider","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sassoftware%2Fsas-airflow-provider/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sassoftware%2Fsas-airflow-provider/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sassoftware%2Fsas-airflow-provider/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sassoftware","download_url":"https://codeload.github.com/sassoftware/sas-airflow-provider/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248036067,"owners_count":21037092,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-20T22:30:58.757Z","updated_at":"2025-04-09T12:09:22.680Z","avatar_url":"https://github.com/sassoftware.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# SAS\u0026reg; Airflow Provider\n\n## Current major capabilities of the SAS\u0026reg; Studio Flow Operator\n\n* Execute a SAS Studio Flow stored either on the File System or in SAS Content\n* Select the Compute Context to be used for execution of a SAS Studio Flow\n* Specify whether SAS logs of a SAS Studio Flow execution should be returned and displayed in Airflow\n* Specify parameters (init_code, wrap_code) to be used for code generation\n* Honor return code of a SAS Studio Flow in Airflow. In particular, if a SAS Studio Flow fails, Airflow raises an exception as well and stops execution\n* Authenticate via oauth token or via user/password (i.e. generation of oauth token prior to each call)\n\n\n## Getting started\nPlease note that this file is no substitute for reading and understanding the Airflow documentation. This file is only intended to provide a quick start for the SAS providers. Unless an issue relates specifically to the SAS providers, the Airflow documentation should be consulted.\n### Install Airflow\nFollow instructions at https://airflow.apache.org/docs/apache-airflow/stable/installation/index.html to install Airflow.\nIf you just want to evaluate the SAS providers, then the simplest path would be to install via PYPI and run Airflow on the local machine in a virtual environment. \n\n### Install the SAS provider\nIf you want to build the package from these sources, install the build module using `pip install build` and then run `python -m build` from the root of the repository which will create a wheel file in the dist subdirectory. \n\n#### Installing in a local virtual environment\nThe SAS provider is available as a package published in PyPI. To install it, switch to the Python environment where Airflow is installed, and run the following command:\n\n`pip install sas-airflow-provider`\n\nIf you would like to install the provider from a package you built locally, run:\n\n`pip install dist/sas_airflow_provider_xxxxx.whl`\n\n#### Installing in a container\nThere are a few ways to provide the package:\n- Environment variable: ```_PIP_ADDITIONAL_REQUIREMENTS``` Set this variable to the command line that will be passed to ```pip install```\n- Create a dockerfile that adds the pip install command to the base image and edit the docker-compose file to use \"build\" (there is a comment in the docker compose file where you can change it)\n\n### Create a connection to SAS\nIn order to connect to SAS Viya from the Airflow operator, you will need to create a connection. The easiest way to do this is to go into the Airflow UI under Admin/Connections and create a new connection using the blue + button. Select SAS from the list of connection types, and enter sas_default as the name. The applicable fields are host (http or https url to your SAS Viya install), login and password. It is also possible to specify an OAuth token by creating a json body in the extra field. For example `{\"token\": \"oauth_token_here\"}`. If a token is found it is used instead of the user/password.\nPlease be aware of security considerations when storing sensitive information in a\nconnection. Consult https://airflow.apache.org/docs/apache-airflow/stable/security/index.html for details.\nTLS verification can be disabled (not recommended) by specifying the following in\nthe extra field `{\"ssl_certificate_verification\": false }`. \n\nIn addition, a custom TLS CA certificate bundle file can be used as follows:\n`{\"ssl_certificate_verification\": \"/path/to/trustedcerts.pem\"}`. Note that the path used for the CA certificate bundle must reference a location within the Airflow pods.\n\nInbound security rules must allow communication from the Airflow web server pod through the ingress defined for SAS Viya. Connection timeout errors might occur if the rule is not in place.\n\n### Running a DAG with a SAS provider\nSee example files in the src/sas_airflow_provider/example_dags directory. These dags can be modified and \nplaced in your Airflow dags directory. \n\nMac note: If you are running Airflow standalone on a Mac, there is a known issue regarding how process forking works.\nThis causes issues with the urllib which is used by the operator. To get around it set NO_PROXY=* in your environment\nprior to running Airflow in standalone mode.\nEg:\n`export NO_PROXY=\"*\"`\n\n### Prerequisites for running demo DAGs\nYou will need to create a SAS Studio Flow or a Job Definition before you can reference it from a DAG. The easiest way is to use the SAS Studio UI to do this.\n\n\n## Contributing\nWe welcome your contributions! Please read [CONTRIBUTING.md](CONTRIBUTING.md) for\ndetails on how to submit contributions to this project.\n\n## License\nThis project is licensed under the [Apache 2.0 License](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsassoftware%2Fsas-airflow-provider","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsassoftware%2Fsas-airflow-provider","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsassoftware%2Fsas-airflow-provider/lists"}