https://github.com/boost/robot-identifier

A ruby library for identifying web robots and spiders
https://github.com/boost/robot-identifier

Last synced: about 2 months ago
JSON representation

A ruby library for identifying web robots and spiders

• Host: GitHub
• URL: https://github.com/boost/robot-identifier
• Owner: boost
• License: other
• Created: 2010-03-02T21:08:47.000Z (almost 15 years ago)
• Default Branch: master
• Last Pushed: 2010-03-09T21:03:01.000Z (almost 15 years ago)
• Last Synced: 2024-04-18T11:31:09.923Z (9 months ago)
• Language: Ruby
• Homepage: http://github.com/boost/robot-identifier
• Size: 74.2 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README
  • Changelog: CHANGELOG
  • License: LICENSE

Awesome Lists containing this project

README

        
== Robot Identifier

=== Installation

* gem install robot-identifier

After installation you must run robot-identifier-update to download the robots database from http://www.robotstxt.org