Projects in Awesome Lists tagged with web-robots
A curated list of projects in awesome lists tagged with web-robots .
https://github.com/acuciureanu/spidertrap-rs
A simple trap for web crawlers
anti-bot anti-scraping bot-detection bot-trap crawler-trap cybersecurity data-privacy ethical-hacking intrusion-detection network-security rust server-defense spider-trap web-crawler web-monitoring web-robots web-scraping web-security web-spider website-protection
Last synced: 24 Jun 2025
https://github.com/jimsmart/progszy
progszy is a hard-caching HTTP(S) proxy server, for web robots.
caching-proxy go http-proxy https-proxy web-robots
Last synced: 25 Mar 2025
