https://github.com/unblocked-web/double-agent

A test suite of common scraper detection techniques. See how detectable your scraper stack is.
https://github.com/unblocked-web/double-agent

crawling puppeteer scraping scrapy secret-agent

Last synced: 6 days ago
JSON representation

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

• Host: GitHub
• URL: https://github.com/unblocked-web/double-agent
• Owner: unblocked-web
• License: mit
• Archived: true
• Created: 2020-02-17T17:36:49.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2022-10-31T20:07:14.000Z (about 2 years ago)
• Last Synced: 2023-11-07T18:58:40.403Z (about 1 year ago)
• Topics: crawling, puppeteer, scraping, scrapy, secret-agent
• Language: TypeScript
• Size: 75.6 MB
• Stars: 131
• Watchers: 7
• Forks: 10
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE

Awesome Lists containing this project