{"id":40014147,"url":"https://github.com/mastak/airflow_multi_dagrun","last_synced_at":"2026-01-19T03:02:33.196Z","repository":{"id":36574175,"uuid":"139226582","full_name":"mastak/airflow_multi_dagrun","owner":"mastak","description":"triggering a DAG run multiple times","archived":false,"fork":false,"pushed_at":"2024-03-01T01:18:19.000Z","size":67,"stargazers_count":88,"open_issues_count":4,"forks_count":27,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-12-22T01:54:52.048Z","etag":null,"topics":["airflow","airflow-plugin"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mastak.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-06-30T06:53:23.000Z","updated_at":"2025-05-05T15:55:21.000Z","dependencies_parsed_at":"2023-02-18T17:46:06.599Z","dependency_job_id":"dd72410e-2d37-464e-8328-72d08a743462","html_url":"https://github.com/mastak/airflow_multi_dagrun","commit_stats":{"total_commits":47,"total_committers":5,"mean_commits":9.4,"dds":0.4893617021276596,"last_synced_commit":"83f9c3c0181812a2c800ebf62640019811d7a5ac"},"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"purl":"pkg:github/mastak/airflow_multi_dagrun","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mastak%2Fairflow_multi_dagrun","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mastak%2Fairflow_multi_dagrun/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mastak%2Fairflow_multi_dagrun/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mastak%2Fairflow_multi_dagrun/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mastak","download_url":"https://codeload.github.com/mastak/airflow_multi_dagrun/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mastak%2Fairflow_multi_dagrun/sbom","scorecard":{"id":623056,"data":{"date":"2025-08-11","repo":{"name":"github.com/mastak/airflow_multi_dagrun","commit":"83f9c3c0181812a2c800ebf62640019811d7a5ac"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":2.8,"checks":[{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Code-Review","score":0,"reason":"Found 1/14 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Pinned-Dependencies","score":-1,"reason":"no dependencies found","details":null,"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: Apache License 2.0: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":-1,"reason":"internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration","details":null,"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"Vulnerabilities","score":5,"reason":"5 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: PYSEC-2013-22 / GHSA-27x4-j476-jp5f","Warn: Project is vulnerable to: PYSEC-2025-49 / GHSA-5rjg-fvgr-3xxf","Warn: Project is vulnerable to: GHSA-cx63-2mw6-8hw5","Warn: Project is vulnerable to: PYSEC-2022-43012 / GHSA-r9hx-vwmv-q579","Warn: Project is vulnerable to: PYSEC-2022-43017 / GHSA-qwmp-2cf2-g9g6"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 22 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}}]},"last_synced_at":"2025-08-21T05:36:46.613Z","repository_id":36574175,"created_at":"2025-08-21T05:36:46.613Z","updated_at":"2025-08-21T05:36:46.613Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28559354,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-19T00:46:33.223Z","status":"online","status_checked_at":"2026-01-19T02:00:08.049Z","response_time":67,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["airflow","airflow-plugin"],"created_at":"2026-01-19T03:02:32.632Z","updated_at":"2026-01-19T03:02:33.189Z","avatar_url":"https://github.com/mastak.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Build Status](https://travis-ci.com/mastak/airflow_multi_dagrun.svg?branch=master)](https://travis-ci.com/mastak/airflow_multi_dagrun) [![Support Ukraine Badge](https://bit.ly/support-ukraine-now)](https://github.com/support-ukraine/support-ukraine)\n\n\n## ======== Help Ukraine\n```\nRusso-Ukrainian War which started in Feb 2014 and escalated since 8 years into \na full-scale war against Ukraine on 24th of February, \nbecame a top cause in the international main stream nowadays.\n```\n[Save Life](https://savelife.in.ua/donate/) – NGO that crowdfunds non-lethal military equipment, such as thermal vision scopes \u0026 supplies it to the front lines. It also provides training for Ukrainian soldiers, as well as researching troops’ needs and social reintegration of veterans.\n\n[Hospitallers](https://www.facebook.com/hospitallers/) – a medical battalion that unites volunteer paramedics and doctors to save the lives of soldiers on the frontline. They crowdfund their vehicle repairs, fuel, and medical equipment.\n## ========\n\n\n# Multi dag run\n\nThis plugin contains operators for triggering a DAG run multiple times\nand you can dynamically specify how many DAG run instances create.\n\nIt can be useful when you have to handle a big data and you want to split it\ninto chunks and run multiple instances of the same task in parallel.\n\nWhen you see a lot launched target DAGs you can set up more workers.\nSo this makes it pretty easy to scale.\n\n## Install\n\n```bash\npip install airflow_multi_dagrun\n```\n\n## Example\n\nCode for scheduling dags\n\n```python\nimport datetime as dt\nfrom airflow import DAG\n\nfrom airflow_multi_dagrun.operators import TriggerMultiDagRunOperator\n\n\ndef generate_dag_run():\n    for i in range(100):\n        yield {'index': i}\n\n\ndefault_args = {\n    'owner': 'airflow',\n    'start_date': dt.datetime(2015, 6, 1),\n}\n\n\ndag = DAG('reindex_scheduler', schedule_interval=None, default_args=default_args)\n\n\nran_dags = TriggerMultiDagRunOperator(\n    task_id='gen_target_dag_run',\n    dag=dag,\n    trigger_dag_id='example_target_dag',\n    python_callable=generate_dag_run,\n)\n```\n\nThis code will schedule dag with id `example_target_dag` 100 times and pass payload to it.\n\n\nExample of triggered dag:\n\n ```python\ndag = DAG(\n    dag_id='example_target_dag',\n    schedule_interval=None,\n    default_args={'start_date': datetime.utcnow(), 'owner': 'airflow'},\n)\n\n\ndef run_this_func(dag_run, **kwargs):\n    print(\"Chunk received: {}\".format(dag_run.conf['index']))\n\n\nchunk_handler = PythonOperator(\n    task_id='chunk_handler',\n    provide_context=True,\n    python_callable=run_this_func,\n    dag=dag\n)\n```\n\n## Run example\nThere is docker-compose config, so it requires docker to be installed: `docker`, `docker-compose`\n1. `make init` - create db\n2. `make add-admin` - create `admin` user (is asks a password)\n3. `make web` - start docker containers, run airflow webserver\n4. `make scheduler` - start docker containers, run airflow scheduler\n\n`make down` will stop and remove docker containers \n\n## Contributions\nIf you have found a bug or have some idea for improvement feel free to create an issue\nor pull request.\n\n## License\nApache 2.0\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmastak%2Fairflow_multi_dagrun","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmastak%2Fairflow_multi_dagrun","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmastak%2Fairflow_multi_dagrun/lists"}