https://github.com/jamesknelson/funnelweb

A framework for creating ruby web crawlers
https://github.com/jamesknelson/funnelweb

Last synced: 13 days ago
JSON representation

A framework for creating ruby web crawlers

• Host: GitHub
• URL: https://github.com/jamesknelson/funnelweb
• Owner: jamesknelson
• License: mit
• Created: 2012-01-15T16:19:11.000Z (almost 13 years ago)
• Default Branch: master
• Last Pushed: 2012-01-23T07:11:15.000Z (almost 13 years ago)
• Last Synced: 2023-04-10T02:16:04.648Z (over 1 year ago)
• Language: Ruby
• Homepage:
• Size: 133 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
= Funnelweb

Funnelweb is a ruby web crawler framework for spidering multiple domains, choosing a different

set of rules for each domain. It is primarily targeted at creating crawlers which find and 

store information on a known set of domains.

= Contributors

Funnelweb is maintained by [James K Nelson](http://jamesknelson.com), from [Numbat Software](http://www.numbat.com.au). Funnelweb was based on [Anemone](http://anemone.rubyforge.org/) by Chris Kite.