{"id":18698304,"url":"https://github.com/ihor/phadoop","last_synced_at":"2025-04-12T07:32:52.437Z","repository":{"id":56989569,"uuid":"2667726","full_name":"ihor/Phadoop","owner":"ihor","description":"Map/reduce jobs for Hadoop in PHP","archived":false,"fork":false,"pushed_at":"2016-01-03T23:12:36.000Z","size":79,"stargazers_count":18,"open_issues_count":0,"forks_count":3,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-26T03:03:16.495Z","etag":null,"topics":["hadoop","map-reduce","php"],"latest_commit_sha":null,"homepage":"","language":"PHP","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ihor.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2011-10-28T20:26:25.000Z","updated_at":"2023-03-26T11:39:07.000Z","dependencies_parsed_at":"2022-08-21T13:50:16.616Z","dependency_job_id":null,"html_url":"https://github.com/ihor/Phadoop","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ihor%2FPhadoop","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ihor%2FPhadoop/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ihor%2FPhadoop/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ihor%2FPhadoop/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ihor","download_url":"https://codeload.github.com/ihor/Phadoop/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248534382,"owners_count":21120310,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["hadoop","map-reduce","php"],"created_at":"2024-11-07T11:27:44.166Z","updated_at":"2025-04-12T07:32:52.114Z","avatar_url":"https://github.com/ihor.png","language":"PHP","readme":"Phadoop\n=======\n\nPhadoop allows you to write map/reduce tasks for Hadoop in PHP. I created it to give a techtalk about Hadoop in the company I worked in. It is not ready for production use yet but can help you to play with Hadoop in PHP.\n\nInstallation\n------------\nDefine the following requirement in your composer.json file:\n```\n\"require\": {\n    \"ihor/phadoop\": \"0.1.x-dev\"\n}\n```\nor simply execute the following in the command line:\n```\ncomposer require ihor/phadoop\n```\n\nUsage\n-----\n```php\nclass Mapper extends \\Phadoop\\MapReduce\\Job\\Worker\\Mapper\n{\n    protected function map($key, $value)\n    {\n        $this-\u003eemit('wordsNumber', count(preg_split('/\\s+/', trim((string) $value))));\n    }\n\n}\n\nclass Reducer extends \\Phadoop\\MapReduce\\Job\\Worker\\Reducer\n{\n    protected function reduce($key, \\Traversable $values)\n    {\n        $result = 0;\n        foreach ($values as $value) {\n            $result += (int) $value;\n        }\n\n        $this-\u003eemit($key, $result);\n    }\n}\n\n$mr = new \\Phadoop\\MapReduce('\u003cpath-to-hadoop\u003e');\n\n$job = $mr-\u003ecreateJob('WordCounter', 'Temp')\n    -\u003esetMapper(new Mapper())\n    -\u003esetReducer(new Reducer())\n    -\u003eclearData()\n    -\u003eaddTask('Hello World')\n    -\u003eaddTask('Hello Hadoop')\n    -\u003eputResultsTo('Temp/Results.txt')\n    -\u003erun();\n\necho $job-\u003egetLastResults();\n```\n\nYou can find more examples in the [examples](https://github.com/ihor/Phadoop/tree/master/examples) directory.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fihor%2Fphadoop","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fihor%2Fphadoop","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fihor%2Fphadoop/lists"}