{"id":25365712,"url":"https://github.com/antoinewg/ocr-page-rank","last_synced_at":"2025-04-09T05:27:15.960Z","repository":{"id":89153429,"uuid":"207910914","full_name":"antoinewg/ocr-page-rank","owner":"antoinewg","description":"PageRank algorithm using Hadoop Streaming","archived":false,"fork":false,"pushed_at":"2019-09-11T21:41:58.000Z","size":448,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"master","last_synced_at":"2025-02-14T23:49:21.559Z","etag":null,"topics":["hadoop-streaming","mapreduce-python","pagerank-algorithm"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/antoinewg.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-09-11T21:34:41.000Z","updated_at":"2019-09-11T21:41:59.000Z","dependencies_parsed_at":"2023-06-14T04:25:45.989Z","dependency_job_id":null,"html_url":"https://github.com/antoinewg/ocr-page-rank","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/antoinewg%2Focr-page-rank","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/antoinewg%2Focr-page-rank/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/antoinewg%2Focr-page-rank/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/antoinewg%2Focr-page-rank/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/antoinewg","download_url":"https://codeload.github.com/antoinewg/ocr-page-rank/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247984111,"owners_count":21028420,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["hadoop-streaming","mapreduce-python","pagerank-algorithm"],"created_at":"2025-02-14T23:49:33.977Z","updated_at":"2025-04-09T05:27:15.943Z","avatar_url":"https://github.com/antoinewg.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🔍PageRank\n\n### Setup\n\n- `hadoop fs -put _movies/graph/adj_list /input` to place the adj list in the input folder.\n\n### Commands\n\n- `hadoop jar hadoop-streaming.jar -input /input/adj_list -output /out -mapper ./mapper.py -reducer reducer.py \u0026\u0026 hadoop fs -cat /out/part-00000` to rrun the Map Reduce algorithm. (Use _adj_ file for smaller tests)\n\n- `hadoop jar hadoop-streaming.jar -input /out/part-00000 -output /maxs -mapper ./max_page_rank.py \u0026\u0026 hadoop fs -cat /maxs/part-00000`: to show the 20 top rresults\n\n## 20 tops results\n\nAfter the first iteration:\n\n```\n1138    0.000126\n1139    0.000126\n1140    0.000126\n1141    0.000126\n1142    0.000126\n1143    0.000126\n1170    0.000123\n1197    0.000126\n1198    0.000126\n1199    0.000126\n12      0.000134\n1200    0.000126\n1209    0.000126\n1210    0.000126\n3701    0.000147\n3966    0.000120\n4       0.000120\n524     0.000120\n5322    0.000128\n93      0.000183\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fantoinewg%2Focr-page-rank","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fantoinewg%2Focr-page-rank","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fantoinewg%2Focr-page-rank/lists"}