https://github.com/acuciureanu/spidertrap-rs
A simple trap for web crawlers
https://github.com/acuciureanu/spidertrap-rs
anti-bot anti-scraping bot-detection bot-trap crawler-trap cybersecurity data-privacy ethical-hacking intrusion-detection network-security rust server-defense spider-trap web-crawler web-monitoring web-robots web-scraping web-security web-spider website-protection
Last synced: 11 months ago
JSON representation
A simple trap for web crawlers
- Host: GitHub
- URL: https://github.com/acuciureanu/spidertrap-rs
- Owner: acuciureanu
- Created: 2023-07-29T16:43:07.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2023-08-02T17:39:41.000Z (almost 3 years ago)
- Last Synced: 2025-03-23T20:51:15.438Z (about 1 year ago)
- Topics: anti-bot, anti-scraping, bot-detection, bot-trap, crawler-trap, cybersecurity, data-privacy, ethical-hacking, intrusion-detection, network-security, rust, server-defense, spider-trap, web-crawler, web-monitoring, web-robots, web-scraping, web-security, web-spider, website-protection
- Language: Rust
- Homepage: https://github.com/acuciureanu/spidertrap-rs
- Size: 7.81 KB
- Stars: 12
- Watchers: 2
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Spider Trap
## Inspiration
This project was inspired by [Spider Trap](https://github.com/adhdproject/spidertrap)
## Description
A simple tool for catching web crawlers.
## Build
```bash
cargo build --release
```
## Run
```bash
cargo run
```
```bash
cargo run -- --port 8080 --directories ./web-directories.txt --min-links 5 --max-links 10 --min-length 3 --max-length 20
```
## Usage
```bash
Usage: spidertrap-rs [OPTIONS]
Options:
--port [default: 8080]
--directories
--min-links [default: 5]
--max-links [default: 10]
--min-length [default: 3]
--max-length [default: 20]
-h, --help Print help
```