https://github.com/yjg30737/onepiece-database

Watching One Piece characters info in ONE PIECE WIKI(FANDOM) with PyQt GUI
https://github.com/yjg30737/onepiece-database

anime database fandom one-piece onepiece onepiece-database onepiece-db pandas pyqt pyqt-examples pyqt-tutorial pyqt-web-crawler pyqt5 pyqt5-gui python python-crawler scrapy wiki-crawler wikia

Last synced: 6 days ago
JSON representation

Watching One Piece characters info in ONE PIECE WIKI(FANDOM) with PyQt GUI

• Host: GitHub
• URL: https://github.com/yjg30737/onepiece-database
• Owner: yjg30737
• License: mit
• Created: 2022-10-28T08:56:13.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2023-07-08T04:17:56.000Z (over 1 year ago)
• Last Synced: 2023-07-08T05:23:01.036Z (over 1 year ago)
• Topics: anime, database, fandom, one-piece, onepiece, onepiece-database, onepiece-db, pandas, pyqt, pyqt-examples, pyqt-tutorial, pyqt-web-crawler, pyqt5, pyqt5-gui, python, python-crawler, scrapy, wiki-crawler, wikia
• Language: Python
• Homepage:
• Size: 995 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# onepiece-database

Get the One Piece characters info with one click from ONE PIECE WIKI(FANDOM)

Using scrapy to crawl the WIKI page data

This is the PyQt GUI version of one-piece-character-data-scraper, this uses it as a submodule.

You can see what kind of info this get in the link above. Such as character name, height..

Also you are able to sort the data as well.

## Requirements

* PyQt5 (for GUI)

* pandas (for converting)

* Scrapy (for getting the data from the site)

* psutil (for getting the process id to show the log)

## How to Install

1. git clone ~

2. python -m pip install -r requirements.txt

3. go into the onepiece_database directory

4. python main.py

## Preview

First screen, press the "get characters info" button

![image](https://user-images.githubusercontent.com/55078043/215363743-abe7c0d9-bc8b-4e38-ad4b-95fe74e8a3b5.png)

New dialog will show up to process the getting characters' info from the pages, wait till it finished

![image](https://user-images.githubusercontent.com/55078043/212575322-ebbc6de3-29a7-483d-bf6f-e9d848d4ff79.png)

You can pause/resume or stop the process. If you press stop button, dialog will be closed.

Result

![image](https://user-images.githubusercontent.com/55078043/215363929-a196d41a-d0fa-45d2-ac9b-69881c0bc7fd.png)

TODO list

* hyperlink

* crawling in background

* colorful logging

* find/save the log message