Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/simonw/robots-txt-demos
A tiny site demonstrating different ways to block search engine crawlers
https://github.com/simonw/robots-txt-demos
Last synced: 28 days ago
JSON representation
A tiny site demonstrating different ways to block search engine crawlers
- Host: GitHub
- URL: https://github.com/simonw/robots-txt-demos
- Owner: simonw
- Created: 2018-07-26T17:15:53.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2018-07-27T21:11:27.000Z (over 6 years ago)
- Last Synced: 2024-10-07T11:54:11.117Z (about 1 month ago)
- Language: HTML
- Homepage: https://robots-txt-demos.now.sh/
- Size: 1.95 KB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 0