https://github.com/htfy96/jd-book-crawler

a ruby-based simple crawler to collect basic info about books on jd.com
https://github.com/htfy96/jd-book-crawler

Last synced: about 2 months ago
JSON representation

a ruby-based simple crawler to collect basic info about books on jd.com

• Host: GitHub
• URL: https://github.com/htfy96/jd-book-crawler
• Owner: htfy96
• License: gpl-2.0
• Created: 2015-09-15T15:02:44.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2016-01-01T11:16:50.000Z (almost 9 years ago)
• Last Synced: 2023-02-26T18:11:53.408Z (almost 2 years ago)
• Language: Ruby
• Size: 2.81 MB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
See example.py for usage in python2.

##Table structure

raw.db

|id: INT PRIMARY KEY NOT NULL | content : TEXT NOT NULL|

Note that content is compressed by Zlib, therefore zlib.decompress may be required.