https://github.com/gughog/smtiv-webscrapper-tool

A web scrapper to scrape data from a smt iv related website.
https://github.com/gughog/smtiv-webscrapper-tool

javascript node puppeteer webscraping

Last synced: about 1 month ago
JSON representation

A web scrapper to scrape data from a smt iv related website.

• Host: GitHub
• URL: https://github.com/gughog/smtiv-webscrapper-tool
• Owner: gughog
• Created: 2020-02-06T15:54:45.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2021-06-05T23:38:04.000Z (over 3 years ago)
• Last Synced: 2023-03-03T13:31:55.598Z (almost 2 years ago)
• Topics: javascript, node, puppeteer, webscraping
• Language: JavaScript
• Size: 38.1 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# SMT IV Webscrapper Tool

* Full app avaliable here: **https://smtivtools.netlify.com/**

This is a NodeJS tool made along with puppeteer to training Web Scrapping concepts. It scrapes some data from the

game Shin Megami Tense IV and Shin Megami Tensei IV: Apocalypse from sites on the web.

### Functionalities:

- Scrapes and creates a JSON file and a SQL Script with data;

- Formats all data into a customizable format;

- Makes me get some fun learning useful concepts with themes i like, such as SMT.

TODO: (SMTIV)

- [x] Scrape creatures

- [x] Scrape skills

- [x] Scrape Apps

- [x] Scrape Special Fusions

TODO: (SMTIV:A)

- [ ] Scrape and make a sign on SMTIV:A exclusives and missing demons

- [ ] Scrape and make a sign on SMTIV:A exclusives and missing skills

- [ ] Scrape and make a sign on SMTIV:A exclusives and missing apps

- [ ] Scrape and make a sign on SMTIV:A exclusives and missing special fusions