https://github.com/suminb/spider

A web page crawler that is designed to use multiple proxy servers
https://github.com/suminb/spider

Last synced: 8 months ago
JSON representation

A web page crawler that is designed to use multiple proxy servers

• Host: GitHub
• URL: https://github.com/suminb/spider
• Owner: suminb
• License: apache-2.0
• Created: 2012-08-06T07:59:54.000Z (almost 14 years ago)
• Default Branch: master
• Last Pushed: 2015-01-01T06:28:42.000Z (over 11 years ago)
• Last Synced: 2025-02-10T09:43:24.491Z (over 1 year ago)
• Language: Python
• Homepage:
• Size: 379 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 13
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
Spider

=======

A light-weight web crawler that utilizes multiple proxy servers.

Travis CI

---------

[![Build Status](https://travis-ci.org/suminb/spider.png?branch=master)](https://travis-ci.org/suminb/spider)