https://github.com/almoggutin/web-crawler-manager-node-js
Backend part of the Web Crawler application. The Web Crawler app takes an input from the user such as a link maximum number of pages and depth. At the end it shows in real time a tree of all the links and pages that the crawler found in the provided URL.
https://github.com/almoggutin/web-crawler-manager-node-js
aws aws-sqs backend-server docker express javascript jest kubernetes nodejs redis rest-api web-crawler web-scraper
Last synced: 2 months ago
JSON representation
Backend part of the Web Crawler application. The Web Crawler app takes an input from the user such as a link maximum number of pages and depth. At the end it shows in real time a tree of all the links and pages that the crawler found in the provided URL.
- Host: GitHub
- URL: https://github.com/almoggutin/web-crawler-manager-node-js
- Owner: almoggutin
- Created: 2021-04-25T16:14:23.000Z (about 5 years ago)
- Default Branch: main
- Last Pushed: 2021-05-18T13:14:17.000Z (about 5 years ago)
- Last Synced: 2023-05-20T19:19:57.666Z (about 3 years ago)
- Topics: aws, aws-sqs, backend-server, docker, express, javascript, jest, kubernetes, nodejs, redis, rest-api, web-crawler, web-scraper
- Language: JavaScript
- Homepage:
- Size: 193 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0