{"id":20210131,"url":"https://github.com/iarthstar/github-scrapper","last_synced_at":"2026-02-15T17:01:27.886Z","repository":{"id":153113959,"uuid":"186677382","full_name":"iarthstar/github-scrapper","owner":"iarthstar","description":"Scrapes issues for the provided github repo","archived":false,"fork":false,"pushed_at":"2019-05-16T07:50:56.000Z","size":18,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-13T21:26:59.445Z","etag":null,"topics":["github-api","issues","repository"],"latest_commit_sha":null,"homepage":null,"language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/iarthstar.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-05-14T18:23:06.000Z","updated_at":"2019-05-16T07:50:58.000Z","dependencies_parsed_at":null,"dependency_job_id":"23b9abab-3e69-408e-9902-bf630dcea7d7","html_url":"https://github.com/iarthstar/github-scrapper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iarthstar%2Fgithub-scrapper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iarthstar%2Fgithub-scrapper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iarthstar%2Fgithub-scrapper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iarthstar%2Fgithub-scrapper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/iarthstar","download_url":"https://codeload.github.com/iarthstar/github-scrapper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241646212,"owners_count":19996536,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["github-api","issues","repository"],"created_at":"2024-11-14T05:46:30.333Z","updated_at":"2026-02-15T17:01:22.840Z","avatar_url":"https://github.com/iarthstar.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Github Api\nFetches issues for the provided github repo url\n\n## Note \n* Github api has rate-limiting i.e. it allows up to 60 requests per hour.\n* Hence, if the issues don't show up, connect to other WIFI, or else wait for hour.\n\n## User Guide\n\n* Open : https://github-scrapper.herokuapp.com/\n* Paste any public github repo url... e.g. https://github.com/iarthstar/purescript-sketch\n* Click SCRAPE... It fetches the issues of the provide repo\n\n## How it works\n\n1. Frontend validates the Repo URL using regex.\n2. Backend fetches the issues page of provided repo.\n    1. fetches the info of repo i.e. issues are present or not\n    2. iterates over the pagination if more issue pages are present.\n    3. Sends required Object back to Frontend.\n3. Frontend displays it.\n\n\n## Development Guide\n\nInitial setup\n\n```bash\n$ npm i\n```\n\nRun Project\n\n```bash\n$ npm start\n```\n\nTo watch for changes\n\n```bash\n$ nodemon\n```\n\n## How the project can be improved\n\n* Suggesting Repos as you type in text-field\n* Handling edge cases of repository not found\n* Advanced filtering of Issues using tags, time period, author, etc.\n* Memoize the issues by storing them in database i.e. by comparing the issues of first page...","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiarthstar%2Fgithub-scrapper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fiarthstar%2Fgithub-scrapper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiarthstar%2Fgithub-scrapper/lists"}