https://github.com/let4be/crusty-core

A small library for building fast and highly customizable web crawlers
https://github.com/let4be/crusty-core

async rust scraper tokio web-crawler

Last synced: 12 months ago
JSON representation

A small library for building fast and highly customizable web crawlers

• Host: GitHub
• URL: https://github.com/let4be/crusty-core
• Owner: let4be
• License: gpl-3.0
• Created: 2021-05-15T16:11:12.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2023-01-04T09:22:09.000Z (over 3 years ago)
• Last Synced: 2024-12-01T12:12:46.316Z (over 1 year ago)
• Topics: async, rust, scraper, tokio, web-crawler
• Language: Rust
• Homepage:
• Size: 436 KB
• Stars: 16
• Watchers: 3
• Forks: 1
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README