https://github.com/gitaaron/scrapy-example

persisting pending requests
https://github.com/gitaaron/scrapy-example

Last synced: about 2 months ago
JSON representation

persisting pending requests

• Host: GitHub
• URL: https://github.com/gitaaron/scrapy-example
• Owner: gitaaron
• Created: 2010-02-11T04:03:59.000Z (almost 15 years ago)
• Default Branch: master
• Last Pushed: 2010-02-11T04:29:35.000Z (almost 15 years ago)
• Last Synced: 2024-04-14T15:04:45.295Z (9 months ago)
• Homepage:
• Size: 85.9 KB
• Stars: 4
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README

Awesome Lists containing this project

README

        
This is a sample scrapy app that enables you to persist the most frequent pending urls so that they can be used upon startup.