https://github.com/anubhavp28/robotstxt-parser-benchmark

Tool to benchmark robots.txt parser
https://github.com/anubhavp28/robotstxt-parser-benchmark

Last synced: 3 months ago
JSON representation

Tool to benchmark robots.txt parser

• Host: GitHub
• URL: https://github.com/anubhavp28/robotstxt-parser-benchmark
• Owner: anubhavp28
• Created: 2019-08-19T07:58:37.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2019-08-19T07:59:43.000Z (about 5 years ago)
• Last Synced: 2024-05-22T18:32:11.301Z (6 months ago)
• Language: DIGITAL Command Language
• Size: 2.34 MB
• Stars: 5
• Watchers: 2
• Forks: 4
• Open Issues: 0
• Metadata Files:

Awesome Lists containing this project