{"id":14965747,"url":"https://github.com/zfael/scrape-it-all","last_synced_at":"2026-02-04T13:39:56.469Z","repository":{"id":36519786,"uuid":"226987376","full_name":"zfael/scrape-it-all","owner":"zfael","description":"Modular web scraper for Node.JS","archived":false,"fork":false,"pushed_at":"2022-12-10T12:09:53.000Z","size":1520,"stargazers_count":0,"open_issues_count":16,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-06-29T16:43:45.726Z","etag":null,"topics":["crawler","scraper","scraping","scraping-websites","web-scraping"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zfael.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-12-09T23:24:27.000Z","updated_at":"2020-02-15T20:54:41.000Z","dependencies_parsed_at":"2023-01-17T02:16:11.613Z","dependency_job_id":null,"html_url":"https://github.com/zfael/scrape-it-all","commit_stats":null,"previous_names":[],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/zfael/scrape-it-all","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zfael%2Fscrape-it-all","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zfael%2Fscrape-it-all/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zfael%2Fscrape-it-all/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zfael%2Fscrape-it-all/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zfael","download_url":"https://codeload.github.com/zfael/scrape-it-all/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zfael%2Fscrape-it-all/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265198361,"owners_count":23726449,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","scraper","scraping","scraping-websites","web-scraping"],"created_at":"2024-09-24T13:35:14.184Z","updated_at":"2026-02-04T13:39:56.443Z","avatar_url":"https://github.com/zfael.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Scrape-it-all 🕷️🕸️\n\u003e Modular web scraper for Node.JS\n\nHave you ever wanted to be aware of when something changes in a webpage and thought about build a scraper to keep posted about it? yeah? so scrape-it-all project aims to solve the initial setup overhead for ya!\u003cbr /\u003e\nBasically, it wraps the whole logic of a given scraper so you just need to call a function and get the result you wanted!\n\nFor instance\n```ts\nimport coinMarketCap from '@scrape-it-all/coin-market-cap';\nconst result = await coinMarketCap.cryptoDetails({ metadata: { crypto: 'bitcoin' } });\n\n// result\n{\n  \"name\": \" Bitcoin (BTC)\",\n  \"icon\": \"https://s2.coinmarketcap.com/static/img/coins/64x64/1.png?_=b4ab82b\",\n  \"currentValue\": \"$9,897.98 USD\"\n}\n```\n\n## How is the repo structured?\n\nThe scrape-it-all project is a monorepo that is built on top of [Lerna](https://github.com/lerna/lerna) so we can leverage individual package based on each scraper available.\u003cbr /\u003e\nIn addition, there might be some core functionality that will be used among scrapers which makes sense to expose that as an individual package as well.\n\n## Wanna help?\n\nWant to report a bug, ask for a feature/scraper (or be the one to implement it), or improve something you feel might be worth? Alright, we get you covered! Read up on the [contributing](https://github.com/zfael/scrape-it-all/blob/master/CONTRIBUTING.md) file to be in sync with our guidelines!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzfael%2Fscrape-it-all","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzfael%2Fscrape-it-all","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzfael%2Fscrape-it-all/lists"}