https://github.com/styts/odesk-scrape
Scrape all web developer profiles from odesk. Includes caching and filtering.
https://github.com/styts/odesk-scrape
Last synced: about 1 year ago
JSON representation
Scrape all web developer profiles from odesk. Includes caching and filtering.
- Host: GitHub
- URL: https://github.com/styts/odesk-scrape
- Owner: styts
- Created: 2013-09-05T06:40:43.000Z (almost 13 years ago)
- Default Branch: master
- Last Pushed: 2014-06-22T10:41:08.000Z (almost 12 years ago)
- Last Synced: 2025-01-28T01:26:45.170Z (over 1 year ago)
- Language: Python
- Size: 121 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
Will attempt to scrape all web developers from odesk (around 3700 in Sept. 2013).
Caches in /tmp/odesk-cache/:
- /\/html
- profiles.pickle
Optionally filter by:
- country
- rate
Installation
============
virtualenv env
source env/bin/activate
pip install -r requirements.txt
Running
=======
```
./main.py
Loading profiles form cache...
(u'David B.', 72.22, u'United States')
(u'Joshua G.', 72.22, u'United States')
(u'Geoff D.', 72.22, u'United States')
(u'Brian M.', 72.22, u'United States')
(u'Aditya A.', 70.0, u'Indonesia')
(u'Christopher A.', 70.0, u'United States')
```