An open API service indexing awesome lists of open source software.

https://github.com/hrbrmstr/robotify

🤖 Browser extension to check for and preview a site's robots.txt in a new tab (if it exists)
https://github.com/hrbrmstr/robotify

browser-extension r-cyber robots-txt

Last synced: 4 months ago
JSON representation

🤖 Browser extension to check for and preview a site's robots.txt in a new tab (if it exists)

Awesome Lists containing this project

README

        

# robotify

A browser extension that places a small robot icon in the toolbar that — when clicked — will extract the fully-qualified host name from the current tab and open up the `robots.txt` file for that site (if there is one) in a new tab.

## Using robotify

Download the [signed extension](dist/robotify-0.1.0-an+fx.xpi) in `dist` (`robotify-0.1.0-an+fx.xpi`) and install it manually or clone the repo and load it as a temporary addon via `about:debugging`.