{"id":18257903,"url":"https://github.com/linkdd/link.parallel","last_synced_at":"2025-04-08T22:46:49.582Z","repository":{"id":62576291,"uuid":"60979196","full_name":"linkdd/link.parallel","owner":"linkdd","description":"Parallel computing framework","archived":false,"fork":false,"pushed_at":"2016-09-15T14:39:10.000Z","size":24,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-03-14T20:48:10.311Z","etag":null,"topics":["map-reduce","parallel-computing","pure-python"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/linkdd.png","metadata":{"files":{"readme":"README.rst","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-06-12T17:06:51.000Z","updated_at":"2020-08-02T12:51:42.000Z","dependencies_parsed_at":"2022-11-03T17:35:58.073Z","dependency_job_id":null,"html_url":"https://github.com/linkdd/link.parallel","commit_stats":null,"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/linkdd%2Flink.parallel","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/linkdd%2Flink.parallel/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/linkdd%2Flink.parallel/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/linkdd%2Flink.parallel/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/linkdd","download_url":"https://codeload.github.com/linkdd/link.parallel/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247941719,"owners_count":21022037,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["map-reduce","parallel-computing","pure-python"],"created_at":"2024-11-05T10:28:06.965Z","updated_at":"2025-04-08T22:46:49.565Z","avatar_url":"https://github.com/linkdd.png","language":"Python","readme":"link.parallel\n=============\n\n**link.parallel** is a database agnostic query system.\n\nSee documentation_ for more informations.\n\n.. _documentation: https://linkparallel.readthedocs.io\n\n.. image:: https://img.shields.io/pypi/l/link.parallel.svg?style=flat-square\n   :target: https://pypi.python.org/pypi/link.parallel/\n   :alt: License\n\n.. image:: https://img.shields.io/pypi/status/link.parallel.svg?style=flat-square\n   :target: https://pypi.python.org/pypi/link.parallel/\n   :alt: Development Status\n\n.. image:: https://img.shields.io/pypi/v/link.parallel.svg?style=flat-square\n   :target: https://pypi.python.org/pypi/link.parallel/\n   :alt: Latest release\n\n.. image:: https://img.shields.io/pypi/pyversions/link.parallel.svg?style=flat-square\n   :target: https://pypi.python.org/pypi/link.parallel/\n   :alt: Supported Python versions\n\n.. image:: https://img.shields.io/pypi/implementation/link.parallel.svg?style=flat-square\n   :target: https://pypi.python.org/pypi/link.parallel/\n   :alt: Supported Python implementations\n\n.. image:: https://img.shields.io/pypi/wheel/link.parallel.svg?style=flat-square\n   :target: https://pypi.python.org/pypi/link.parallel\n   :alt: Download format\n\n.. image:: https://travis-ci.org/linkdd/link.parallel.svg?branch=master\u0026style=flat-square\n   :target: https://travis-ci.org/linkdd/link.parallel\n   :alt: Build status\n\n.. image:: https://coveralls.io/repos/github/linkdd/link.parallel/badge.svg?style=flat-square\n   :target: https://coveralls.io/r/linkdd/link.parallel\n   :alt: Code test coverage\n\n.. image:: https://img.shields.io/pypi/dm/link.parallel.svg?style=flat-square\n   :target: https://pypi.python.org/pypi/link.parallel/\n   :alt: Downloads\n\n.. image:: https://landscape.io/github/linkdd/link.parallel/master/landscape.svg?style=flat-square\n   :target: https://landscape.io/github/linkdd/link.parallel/master\n   :alt: Code Health\n\nInstallation\n------------\n\n.. code-block:: text\n\n   pip install link.parallel\n\nFeatures\n--------\n\n * parallel loops interface with IPython and multiprocessing drivers\n * Map/Reduce middleware\n\nExamples\n--------\n\nCreate your map/reduce functions:\n\n.. code-block:: python\n\n   from b3j0f.task import register_task\n\n\n   @register_task('mymap')\n   def mymap(mapper, item):\n       if item['i'] \u003c 5:\n           mapper.emit('i_lt_5', item)\n\n       elif item['i'] \u003e 5:\n           mapper.emit('i_gt_5', item)\n\n       else:\n           mapper.emit('i_eq_5', item)\n\n\n   @register_task('myreduce')\n   def myreduce(key, values):\n       return (key, len(values))\n\n\nGet input data and pass it to the middleware:\n\n.. code-block:: python\n\n   from link.middleware.core import Middleware\n\n   mapreduce = Middleware.get_middleware_by_uri(\n       'mapreduce+ipython:///test/classify?mapcb=mymap\u0026reducecb=myreduce'\n   )\n\n   items = # load items\n   result = dict(mapreduce(items))\n\n   print(result)\n\nDonating\n--------\n\n.. image:: https://liberapay.com/assets/widgets/donate.svg\n   :target: https://liberapay.com/linkdd/donate\n   :alt: Support via Liberapay\n","funding_links":["https://liberapay.com/linkdd/donate"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flinkdd%2Flink.parallel","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flinkdd%2Flink.parallel","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flinkdd%2Flink.parallel/lists"}