An open API service indexing awesome lists of open source software.

https://github.com/kami/wadodo-crawlers


https://github.com/kami/wadodo-crawlers

Last synced: over 1 year ago
JSON representation

Awesome Lists containing this project

README

          

# Wadodo Crawlers

## Available Crawlers

* `vegas.com`

## Usage

```bash
scrapy crawl -o -t jsonlines \
--flickr_api_key= [--set=DOWNLOAD_DELAY=]
```

All of the available options are listed at [http://doc.scrapy.org/en/latest/topics/settings.html](http://doc.scrapy.org/en/latest/topics/settings.html)