https://github.com/simonsdave/gaming-spiders
Collection of Cloudfeaster spiders for various gaming services
https://github.com/simonsdave/gaming-spiders
Last synced: 4 months ago
JSON representation
Collection of Cloudfeaster spiders for various gaming services
- Host: GitHub
- URL: https://github.com/simonsdave/gaming-spiders
- Owner: simonsdave
- License: mit
- Created: 2015-06-08T21:01:29.000Z (about 11 years ago)
- Default Branch: master
- Last Pushed: 2022-10-23T14:18:34.000Z (over 3 years ago)
- Last Synced: 2025-03-28T21:34:36.783Z (about 1 year ago)
- Language: Python
- Homepage:
- Size: 266 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: docs/contributing.md
- License: LICENSE.md
Awesome Lists containing this project
README
# gaming-spiders
[](http://opensource.org/licenses/MIT)
[](https://www.python.org/downloads/release/python-390/)
[](https://www.codefactor.io/repository/github/simonsdave/gaming-spiders/overview/master)
[](https://circleci.com/gh/simonsdave/gaming-spiders)
[](https://hub.docker.com/r/simonsdave/gaming-spiders)
A collection of [Cloudfeaster](https://github.com/simonsdave/cloudfeaster)
spiders for various gaming services.
## Getting Started
First follow [these](dev_env/README.md) instructions to get your development environment setup.
Now let's run one of the spiders.
```bash
~> run-spider.sh gamehouseonlinegames.py | jq .
{
"1": {
"title": "TextTwist 2",
"link": "https://www.gamehouse.com/online-games/texttwist-2"
},
"2": {
"title": "Daily Mahjong",
"link": "https://www.gamehouse.com/online-games/daily-mahjong"
},
"3": {
"title": "Bubblez!",
"link": "https://www.gamehouse.com/online-games/bubblez!"
},
"4": {
"title": "Rainforest Adventure",
"link": "https://www.gamehouse.com/online-games/rainforest-adventure"
},
"5": {
"title": "Jewel Quest",
"link": "https://www.gamehouse.com/online-games/jewel-quest"
},
"6": {
"title": "Snow Queen 2",
"link": "https://www.gamehouse.com/online-games/snow-queen-2"
},
"7": {
"title": "Rummy",
"link": "https://www.gamehouse.com/online-games/rummy"
},
"8": {
"title": "Mah Jong Medley",
"link": "https://www.gamehouse.com/online-games/mah-jong-medley"
},
"9": {
"title": "Mahjong The Endless Journey",
"link": "https://www.gamehouse.com/online-games/mahjong-the-endless-journey"
},
"10": {
"title": "Mahjongg Gardens",
"link": "https://www.gamehouse.com/online-games/mahjongg-gardens"
},
"_metadata": {
"status": {
"code": 0,
"message": "Ok"
},
"spider": {
"name": "gamehouseonlinegames.py",
"version": "sha256:a0717e4bef6cf41069b40efc8d6bb6941e5e899231e12d5a1af083c62b74fe1d"
},
"crawlArgs": [],
"crawlTime": {
"started": "2020-12-29T21:30:46.707601+00:00",
"durationInMs": 3957
}
},
"_debug": {
"screenshot": "/var/folders/zc/51nmqy_93559vqw_1y526y240000gn/T/tmp.ConMqmqP/screenshot.png",
"crawlLog": "/var/folders/zc/51nmqy_93559vqw_1y526y240000gn/T/tmp.ConMqmqP/crawl-log.txt",
"chromeDriverLog": "/var/folders/zc/51nmqy_93559vqw_1y526y240000gn/T/tmp.ConMqmqP/chromedriver-log.txt"
}
}
~>
```
## What Next
* see [this](https://github.com/simonsdave/cloudfeaster/blob/master/docs/story.md) for some background on the Cloudfeaster project
* see [these](docs/contributing.md) instructions
describe how to setup your development environment and
start contributing to these spiders
* [this](https://github.com/simonsdave/cloudfeaster/blob/master/docs/spider_authors.md) describes
how to author spiders using Cloudfeaster