https://github.com/sing1ee/scrapy-top
simple tools like linux top command to view scrapy status
https://github.com/sing1ee/scrapy-top
Last synced: over 1 year ago
JSON representation
simple tools like linux top command to view scrapy status
- Host: GitHub
- URL: https://github.com/sing1ee/scrapy-top
- Owner: sing1ee
- License: apache-2.0
- Created: 2014-04-01T01:56:02.000Z (over 12 years ago)
- Default Branch: master
- Last Pushed: 2014-04-01T03:43:55.000Z (over 12 years ago)
- Last Synced: 2025-02-02T10:35:47.083Z (over 1 year ago)
- Language: Python
- Size: 207 KB
- Stars: 2
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
scrapy-top
==========
simple tools like linux top command to view scrapy status
###Requests
1. telnetlib default in python distribution
2. prettytable https://code.google.com/p/prettytable/
###Install
```python
python setup.py install
```
maybe you need **sudo**
###Run
For now, you can scrapy-top -i 2 -h localhost -p 6023
1. -i: interval seconds, defaut 2 secs
2. -h: host, default localhost
3. -p: port scrapy default telnet port 6023
###Output
| Key | Value |
| ----------------------------------- | --------------------------- |
| log_count/DEBUG | 27 |
| request_depth_max | 4 |
| start_time | 2014-04-01 02:12:42.619696 |
| log_count/INFO | 6 |
| downloader/request_method_count/GET | 28 |
| scheduler/dequeued/redis | 28 |
| downloader/request_bytes | 12160 |