Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/Antosser/web-crawler
Rust Web Crawler that finds every page, image, and script on a website (and downloads it)
https://github.com/Antosser/web-crawler
crawler html rust seo web
Last synced: about 11 hours ago
JSON representation
Rust Web Crawler that finds every page, image, and script on a website (and downloads it)
- Host: GitHub
- URL: https://github.com/Antosser/web-crawler
- Owner: Antosser
- Created: 2023-01-22T19:43:09.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-04-23T08:41:47.000Z (5 months ago)
- Last Synced: 2024-04-23T22:55:50.191Z (5 months ago)
- Topics: crawler, html, rust, seo, web
- Language: Rust
- Homepage:
- Size: 220 KB
- Stars: 5
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-rust-list - Antosser/web-crawler - crawler?style=social"/> : Rust Web Crawler that finds every page, image, and script on a website (and downloads it) (Web Crawler)
- awesome-rust-list - Antosser/web-crawler - crawler?style=social"/> : Rust Web Crawler that finds every page, image, and script on a website (and downloads it) (Web Crawler)