https://github.com/onyxfish/fakerwiki

FakerWiki is a library for local testing of Python ScraperWiki scripts.
https://github.com/onyxfish/fakerwiki

Last synced: about 1 month ago
JSON representation

FakerWiki is a library for local testing of Python ScraperWiki scripts.

• Host: GitHub
• URL: https://github.com/onyxfish/fakerwiki
• Owner: onyxfish
• Created: 2010-10-27T03:03:33.000Z (about 14 years ago)
• Default Branch: master
• Last Pushed: 2011-09-08T21:36:00.000Z (about 13 years ago)
• Last Synced: 2023-04-12T09:29:22.677Z (over 1 year ago)
• Language: Python
• Homepage:
• Size: 94.7 KB
• Stars: 16
• Watchers: 1
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.textile

Awesome Lists containing this project

README

        
h1. FakerWiki

Fakerwiki is a library for local testing of Python "ScraperWiki":http://scraperwiki.com/ scripts.  Mostly it's just a copy of the ScraperWiki library with the database bits removed.

h2. Usage


cd fakerwiki

mkvirtualenv --no-site-packages fakerwiki

pip install -r requirements.txt

python setup.py install

python your_script_name.py



You can also use 'pip install fakerwiki', but this obviously won't build out your virtualenv with the standard scraperwiki packages from the requirements.txt in the repository.

h2. What works?

scraperwiki.scrape()

scraperwiki.datastore.save()

h2. What could be added easily?

scraperwiki.datastore.retrieve()

scraperwiki.datastore.fetch()

scraperwiki.metadata.save()

scraperwiki.metadata.get()

geocoding with dummy data

local caching of scraped pages

h2. License

GPLv3 ("same as ScraperWiki":https://kforgehosting.com/scraperwiki/trac/browser/LICENSE.txt)