https://github.com/sanxiyn/dating

Dating sites crawler
https://github.com/sanxiyn/dating

Last synced: 23 days ago
JSON representation

Dating sites crawler

• Host: GitHub
• URL: https://github.com/sanxiyn/dating
• Owner: sanxiyn
• Created: 2017-07-05T15:51:29.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2017-07-24T13:48:49.000Z (over 7 years ago)
• Last Synced: 2024-12-24T06:39:58.822Z (about 1 month ago)
• Language: Python
• Homepage:
• Size: 25.4 KB
• Stars: 0
• Watchers: 3
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
You need to have [Scrapy](https://scrapy.org/) installed. Example usage:

```

$ scrapy runspider -a n=30 -o behappy2day-30.jl behappy2day.py

$ cat behappy2day-30.jl | jq -c 'select(.country == "Ukraine") | {id, url}' | head -n 40 > UA.jl

$ python download.py UA.jl UA

$ python build_html.py behappy2day UA.jl UA.html

```