{"id":20690762,"url":"https://github.com/levsh/arrlio","last_synced_at":"2026-05-29T12:01:53.126Z","repository":{"id":62216660,"uuid":"390099191","full_name":"levsh/arrlio","owner":"levsh","description":"Asyncio distributed task system with local and RabbitMQ backends","archived":false,"fork":false,"pushed_at":"2025-05-17T14:51:53.000Z","size":1478,"stargazers_count":0,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-09-19T21:36:24.694Z","etag":null,"topics":["asyncio","distributed","distributed-systems","python","rabbitmq","task","task-manager","task-queue","task-runner","workflow","workflow-engine"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/levsh.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2021-07-27T19:11:10.000Z","updated_at":"2025-05-17T14:51:56.000Z","dependencies_parsed_at":"2024-04-15T12:26:09.025Z","dependency_job_id":null,"html_url":"https://github.com/levsh/arrlio","commit_stats":null,"previous_names":[],"tags_count":30,"template":false,"template_full_name":null,"purl":"pkg:github/levsh/arrlio","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/levsh%2Farrlio","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/levsh%2Farrlio/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/levsh%2Farrlio/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/levsh%2Farrlio/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/levsh","download_url":"https://codeload.github.com/levsh/arrlio/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/levsh%2Farrlio/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33650712,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-05-29T02:00:06.066Z","response_time":107,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["asyncio","distributed","distributed-systems","python","rabbitmq","task","task-manager","task-queue","task-runner","workflow","workflow-engine"],"created_at":"2024-11-16T23:14:11.066Z","updated_at":"2026-05-29T12:01:53.099Z","avatar_url":"https://github.com/levsh.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Arrlio [WIP]\n\n[Documentation](https://levsh.github.io/arrlio) (WIP)\n\nAsyncio distributed task/workflow system with supports generators and graphs\n\n![tests](https://github.com/levsh/arrlio/workflows/tests/badge.svg)\n![coverage](https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/levsh/727ed723ccaee0d5825513af6472e3a5/raw/coverage.json)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n\n### Installation\n```bash\npip install arrlio\n```\nOr to use latest develop version\n```bash\npip install git+https://github.com/levsh/arrlio\n```\n\n### Usage\n\n#### Create tasks file\n```python\n# tasks.py\n\nimport io\n\nimport arrlio\nimport invoke\n\n@arrlio.task\nasync def hello_world():\n    return \"Hello World!\"\n\n# task custom name\n@arrlio.task(name=\"foo\")\nasync def foo():\n    arrlio.logger.info(\"Hello from task 'foo'!\")\n\n# exception example\n@arrlio.task\nasync def exception():\n    raise ZeroDivisionError\n\n# Arrlio supports generators and async generators\n@arrlio.task\ndef xrange(count):\n    for x in range(count):\n        yield x\n\n@arrlio.task\nasync def add_one(value: str):\n    return int(value) + 1\n\n\n@arrlio.task\nasync def bash(cmd, stdin: str = None):\n    in_stream = io.StringIO(stdin)\n    out_stream = io.StringIO()\n    result = invoke.run(\n        cmd,\n        in_stream=in_stream,\n        out_stream=out_stream\n    )\n    return result.stdout\n```\n\n#### Create main file and run it\n\n```python\nimport asyncio\nimport logging\n\nimport arrlio\nimport tasks\n\nlogger = logging.getLogger(\"arrlio\")\nlogger.setLevel(\"INFO\")\n\n\nasync def main():\n    app = arrlio.App(arrlio.Config())\n\n    async with app:\n        await app.consume_tasks()\n\n        # call by task object\n        ar = await app.send_task(tasks.hello_world)\n        logger.info(await ar.get())\n\n        # call by task name\n        ar = await app.send_task(\"foo\")\n        logger.info(await ar.get())\n\n        # task args example\n        ar = await app.send_task(tasks.add_one, args=(1,))\n        logger.info(await ar.get())\n\n        # exception example\n        try:\n            ar = await app.send_task(tasks.exception)\n            logger.info(await ar.get())\n        except Exception as e:\n            print(f\"\\nThis is example exception for {app.result_backend}:\\n\")\n            logger.exception(e)\n            print()\n\n        # generator example\n        results = []\n        ar = await app.send_task(tasks.xrange, args=(3,))\n        async for result in ar:\n            results.append(result)\n        logger.info(results)  # -\u003e [0, 1, 2]\n\n\nif __name__ == \"__main__\":\n    asyncio.run(main())\n```\n\n#### Arrlio supports graph execution\n```python\nimport asyncio\nimport logging\n\nimport arrlio\nimport tasks\n\nlogger = logging.getLogger(\"arrlio\")\nlogger.setLevel(\"INFO\")\n\n\nasync def main():\n    graph = arrlio.Graph(\"My Graph\")\n    graph.add_node(\"A\", tasks.add_one, root=True)\n    graph.add_node(\"B\", tasks.add_one)\n    graph.add_node(\"C\", tasks.add_one)\n    graph.add_edge(\"A\", \"B\")\n    graph.add_edge(\"B\", \"C\")\n\n\t# arrlio.plugins.events and arrlio.plugins.graphs\n\t# plugins are required\n    app = arrlio.App(\n        arrlio.Config(\n            plugins=[\n                {\"module\": \"arrlio.plugins.events\"},\n                {\"module\": \"arrlio.plugins.graphs\"},\n            ],\n        )\n    )\n\n    async with app:\n        await app.consume_tasks()\n\n\t\t# execute graph with argument 0\n        ars = await app.send_graph(graph, args=(0,))\n        logger.info(\"A: %i\", await ars[\"A\"].get())  # -\u003e A: 1\n        logger.info(\"B: %i\", await ars[\"B\"].get())  # -\u003e B: 2\n        logger.info(\"C: %i\", await ars[\"C\"].get())  # -\u003e C: 3\n\n\nif __name__ == \"__main__\":\n    asyncio.run(main())\n```\n#### Another graph example\n```python\nimport asyncio\nimport logging\n\nimport arrlio\nimport tasks\n\nlogger = logging.getLogger(\"arrlio\")\nlogger.setLevel(\"INFO\")\n\n\nasync def main():\n    graph = arrlio.Graph(\"My Graph\")\n    graph.add_node(\"A\", tasks.bash, root=True)\n    graph.add_node(\"B\", tasks.bash, args=(\"wc -w\",))\n    graph.add_edge(\"A\", \"B\")\n\n    app = arrlio.App(\n        arrlio.Config(\n            plugins=[\n                {\"module\": \"arrlio.plugins.events\"},\n                {\"module\": \"arrlio.plugins.graphs\"},\n            ],\n        )\n    )\n\n    async with app:\n        await app.consume_tasks()\n\n        ars = await app.send_graph(\n            graph,\n            args=('echo \"Number of words in this sentence:\"',)\n        )\n        logger.info(await asyncio.wait_for(ars[\"B\"].get(), timeout=2))  # -\u003e 6\n\n\nif __name__ == \"__main__\":\n    asyncio.run(main())\n```\n\n#### And more examples\n```bash\npoetry install\npoetry run python examples/main.py\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flevsh%2Farrlio","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flevsh%2Farrlio","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flevsh%2Farrlio/lists"}