Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/miohtama/scrapekit


https://github.com/miohtama/scrapekit

Last synced: 23 days ago
JSON representation

Awesome Lists containing this project

README

        

We use `GSpread `_ library to write results
directly to Google Docs spreadsheet in real-time.

Installation
--------------

curl -L -o virtualenv.py https://raw.github.com/pypa/virtualenv/master/virtualenv.py
python virtualenv.py venv
. venv/bin/activate
pip install selenium gspread ipdb

Running
-----------------

. venv/bin/activate
GOOGLE_EMAIL="xxx" GOOGLE_PASSWORD="yyyy" GOOGLE_SPREADSHEET="zzz" python modelmayhem.py

Alternative solutions
------------------------

* http://nrabinowitz.github.com/pjscrape/

* `Selenium WebDriver API `_

* `Selenium WebElement API `_