https://github.com/bububa/airport

A crawler system for vertical search engines.
https://github.com/bububa/airport

Last synced: about 5 hours ago
JSON representation

A crawler system for vertical search engines.

• Host: GitHub
• URL: https://github.com/bububa/airport
• Owner: bububa
• Created: 2010-04-21T09:41:23.000Z (over 14 years ago)
• Default Branch: master
• Last Pushed: 2010-08-03T13:49:03.000Z (over 14 years ago)
• Last Synced: 2023-04-18T23:29:46.424Z (over 1 year ago)
• Language: C
• Homepage: http://syd.todayclose.com/
• Size: 3.75 MB
• Stars: 9
• Watchers: 0
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README

Awesome Lists containing this project

README

        
A distributed crawler and parser system for vertical search engines designed based on Lego (http://github.com/bububa/Lego) protocol.

[REQUIREMENTS]

*nix platform

curl

boost 1.42 ++

icu

jsoncpp

botan

mysql

mongodb

tiny

[RELATED LIBS]

libcurl

libcurlpp

libboost_regex

libboost_filesystem

libboost_system

libboost_program_options

libboost_date_time

libchardet

libiconv

libboost_thread

libjson_linux-gcc-4.2.1_libmt

libbotan

libmongoclient

libmysqlpp

libmysqlclient

libtidy

libticppd

[CONTACT]

name: Syd Xu

email: [email protected]

blog: http://syd.todayclose.com

twitter: http://twitter.com/bububa/