https://github.com/ervin-sungkono/mlbb-wiki-scraper

Scraping tool to extract data from MLBB Wiki and output as JSON file
https://github.com/ervin-sungkono/mlbb-wiki-scraper

fs javascript json nodejs p-limit puppeteer

Last synced: 24 days ago
JSON representation

Scraping tool to extract data from MLBB Wiki and output as JSON file

• Host: GitHub
• URL: https://github.com/ervin-sungkono/mlbb-wiki-scraper
• Owner: ervin-sungkono
• License: mit
• Created: 2024-10-28T09:23:22.000Z (2 months ago)
• Default Branch: main
• Last Pushed: 2024-10-28T09:28:14.000Z (2 months ago)
• Last Synced: 2024-10-28T12:26:11.755Z (2 months ago)
• Topics: fs, javascript, json, nodejs, p-limit, puppeteer
• Language: JavaScript
• Homepage:
• Size: 1.24 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# MLBB Wiki Scraper

Tools to scrape web data from the MLBB Wiki and output it as a JSON file, currently the available data that can be scraped are:

- Heroes Data

- Equipment Data

- Emblem Data

This web scraping tool is mainly built using Puppeteer, you can check the documentation by [Clicking Here](https://pptr.dev/category/introduction)

## Resources

- [Puppeteer](https://www.npmjs.com/package/puppeteer)

- [P-Limit](https://www.npmjs.com/package/p-limit)

## Installation and Setup

1. Clone this repository

```sh

git clone https://github.com/ervin-sungkono/qr-code-gen.git

```

2. Install dependency

```sh

npm install

```

3. Run the app

```sh

npm start

```

4. All output files will show in the following directories:

- `/output` for all heroes, equipments, and emblems

- `/heroes` for each hero's detail

- `/equipment` for each equipment's detail

## Preview

### Hero List JSON Example

![Hero Preview](preview/hero.png)

### Equipment List JSON Example

![Equipment Preview](preview/equipment.png)

### Emblem List JSON Example

![Emblem Preview](preview/emblem.png)