Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/prabhakar267/ign-top-100-villian
Simple parser script :v:
https://github.com/prabhakar267/ign-top-100-villian
ign-website parser php python villians
Last synced: 4 months ago
JSON representation
Simple parser script :v:
- Host: GitHub
- URL: https://github.com/prabhakar267/ign-top-100-villian
- Owner: prabhakar267
- Created: 2015-12-02T11:53:08.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2016-04-23T21:34:10.000Z (almost 9 years ago)
- Last Synced: 2024-10-14T09:10:59.827Z (4 months ago)
- Topics: ign-website, parser, php, python, villians
- Language: PHP
- Homepage: http://prabhakargupta.com/projects/top-100-villians/
- Size: 2.11 MB
- Stars: 8
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# IGN Top 100 Villians :hocho:
Simple scripts written in both PHP and Python to scrape the data from [IGN Website](http://ca.ign.com/top/comic-book-villains/) to scrape a list of Top 100 Comic Book Villains of All Time :hocho: (because villians are way more cool than heroes) and save in a MySQL database.
Then display it in a list one-page format which was not present on IGN original website.
I basically built this scraper so that I could read about all the villians on a single page and I don't need to click on NEXT for every other villian (Yeah, I am lazy :sleepy:).
## Instructions to Run Scrapper
+ Import [MySQL dump file](/scrapper/db/data.sql) in your database
+ Add database and user credentials in respective files ([connection.inc.php](/scrapper/php/inc/connection.inc.php) for PHP and [DBdetails.py](/scrapper/python/DBdetails.py) for Python)
+ Run following instruction in your terminal
For PHP
```php
php /scrapper/php/fetch_data.php
```
For Python
```python
python /scrapper/python/main.py
```
## Screenshots
**Top Frame**
**Bottom Frame**
