https://github.com/spencerlepine/readme-crawler
A Node.js web crawler to download README files and follow contained links. Fetch repositories from a valid GitHub URL
https://github.com/spencerlepine/readme-crawler
crawler javascript node nodejs readme scraper web-crawler webcrawer
Last synced: about 1 year ago
JSON representation
A Node.js web crawler to download README files and follow contained links. Fetch repositories from a valid GitHub URL
- Host: GitHub
- URL: https://github.com/spencerlepine/readme-crawler
- Owner: spencerlepine
- Created: 2021-08-15T04:02:50.000Z (almost 5 years ago)
- Default Branch: main
- Last Pushed: 2021-08-16T19:00:41.000Z (almost 5 years ago)
- Last Synced: 2024-05-04T00:07:09.247Z (about 2 years ago)
- Topics: crawler, javascript, node, nodejs, readme, scraper, web-crawler, webcrawer
- Language: JavaScript
- Homepage: https://www.npmjs.com/package/readme-crawler
- Size: 42 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md