https://github.com/spencerlepine/readme-crawler

A Node.js web crawler to download README files and follow contained links. Fetch repositories from a valid GitHub URL
https://github.com/spencerlepine/readme-crawler

crawler javascript node nodejs readme scraper web-crawler webcrawer

Last synced: 3 months ago
JSON representation

A Node.js web crawler to download README files and follow contained links. Fetch repositories from a valid GitHub URL

• Host: GitHub
• URL: https://github.com/spencerlepine/readme-crawler
• Owner: spencerlepine
• Created: 2021-08-15T04:02:50.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2021-08-16T19:00:41.000Z (over 3 years ago)
• Last Synced: 2024-05-04T00:07:09.247Z (9 months ago)
• Topics: crawler, javascript, node, nodejs, readme, scraper, web-crawler, webcrawer
• Language: JavaScript
• Homepage: https://www.npmjs.com/package/readme-crawler
• Size: 42 KB
• Stars: 4
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project