https://github.com/davelongdev/link-report-crawler

A web crawler using Node.js that crawls a site and returns a report showing all internal links.
https://github.com/davelongdev/link-report-crawler

crawler crawling javascript seo seo-tools

Last synced: 7 days ago
JSON representation

A web crawler using Node.js that crawls a site and returns a report showing all internal links.

• Host: GitHub
• URL: https://github.com/davelongdev/link-report-crawler
• Owner: davelongdev
• Created: 2024-08-12T14:41:06.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2024-08-14T14:41:47.000Z (3 months ago)
• Last Synced: 2024-08-14T20:17:16.363Z (3 months ago)
• Topics: crawler, crawling, javascript, seo, seo-tools
• Language: JavaScript
• Homepage: https://davelongdev.com
• Size: 41 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Link Report Crawler

## Summary

This is a command line application built with Node.js and JavaScript that crawls a web site and prints a report to the console showing the number of links to each page on the site.  

The app sorts the links from highst number of links to the lowest number of links.

## Build Process

I built this app by following the project guidelines and video on [boot.dev](https://boot.dev).

## Coming Soon

I plan to add some more functionality to this app in the near future.  Ideas for additional functionality:

- show outgoing links in a seperate category

- print output to a txt file or csv file.