https://github.com/dawnbrandbots/yaml-yugipedia
An automatically-updated collection of wikitexts from Yugipedia. Part of YAML Yugi.
https://github.com/dawnbrandbots/yaml-yugipedia
etl mediawiki yaml yaml-yugi yu-gi-oh yugioh yugipedia
Last synced: 10 months ago
JSON representation
An automatically-updated collection of wikitexts from Yugipedia. Part of YAML Yugi.
- Host: GitHub
- URL: https://github.com/dawnbrandbots/yaml-yugipedia
- Owner: DawnbrandBots
- License: lgpl-3.0
- Created: 2022-06-24T01:17:36.000Z (almost 4 years ago)
- Default Branch: master
- Last Pushed: 2025-06-29T03:25:17.000Z (12 months ago)
- Last Synced: 2025-06-29T04:27:01.966Z (12 months ago)
- Topics: etl, mediawiki, yaml, yaml-yugi, yu-gi-oh, yugioh, yugipedia
- Language: Python
- Homepage:
- Size: 190 MB
- Stars: 4
- Watchers: 3
- Forks: 1
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: COPYING
Awesome Lists containing this project
README
# YAML [Yugipedia](https://yugipedia.com)
[](https://github.com/DawnbrandBots/yaml-yugipedia/actions/workflows/update.yml)
[](https://github.com/DawnbrandBots/yaml-yugipedia/actions/workflows/python.yml)
An automatically-updated collection of wikitexts from Yugipedia of cards for intake and transformation into the
[YAML Yugi](https://github.com/DawnbrandBots/yaml-yugi) database. Storing a cache here reduces load on the wiki while
also serving as an external backup of current wiki text. The YAML Yugi project aims to create a comprehensive,
machine-readable, human-editable database of _Yu-Gi-Oh! Trading Card Game_ (TCG), _Official Card Game_ (OCG),
_Master Duel_ video game, _Rush Duel_, and _Speed Duel_.
All files under [`/wikitext`](/wikitext) and [`/semantic-mediawiki`](/semantic-mediawiki) are downloaded using MediaWiki APIs and copyright belongs to their original
holders. Any Yugipedia-original content is licensed under [CC BY-SA 4.0](https://yugipedia.com/wiki/Yugipedia:Licensing)
but most card text is © Studio Dice/SHUEISHA, TV TOKYO, KONAMI.
The remaining files — the actual source code of this stage of the pipeline — are available under the
GNU Lesser General Public License 3.0 or later. See [COPYING](./COPYING) and [COPYING.LESSER](./COPYING.LESSER)
for more details.
## Categories being automatically downloaded
- [Duel Monsters cards](https://yugipedia.com/wiki/Category:Duel_Monsters_cards)
- [Rush Duel cards](https://yugipedia.com/wiki/Category:Rush_Duel_cards)
- [Skill Cards](https://yugipedia.com/wiki/Category:Skill_Cards)
- [TCG and OCG archetypes](https://yugipedia.com/wiki/Category:TCG_and_OCG_archetypes)
- [Yu-Gi-Oh! Master Duel cards](https://yugipedia.com/wiki/Category:Yu-Gi-Oh!_Master_Duel_cards)
- [Yu-Gi-Oh! Master Duel Forbidden & Limited Lists](https://yugipedia.com/wiki/Category:Yu-Gi-Oh!_Master_Duel_Forbidden_%26_Limited_Lists)
- [Tokens](https://yugipedia.com/wiki/Category:Tokens)
- [Cards by Konami index number](https://yugipedia.com/wiki/Category:Cards_by_Konami_index_number)
- [Yu-Gi-Oh! Duel Links cards](https://yugipedia.com/wiki/Category:Yu-Gi-Oh!_Duel_Links_cards)
- [Yu-Gi-Oh! Duel Links Skills](https://yugipedia.com/wiki/Category:Yu-Gi-Oh!_Duel_Links_Skills)
- [Yu-Gi-Oh! Master Duel accessories](https://yugipedia.com/wiki/Category:Yu-Gi-Oh!_Master_Duel_accessories)
- [TCG Speed Duel Forbidden & Limited Lists](https://yugipedia.com/wiki/Category:TCG_Speed_Duel_Forbidden_%26_Limited_Lists)
- [Sayings](https://yugipedia.com/wiki/Category:Sayings)
- [Yu-Gi-Oh! RUSH DUEL: Saikyo Battle Royale!! Let's Go! Go Rush!! card artworks](https://yugipedia.com/wiki/Category:Yu-Gi-Oh!_RUSH_DUEL:_Saikyo_Battle_Royale!!_Let's_Go!_Go_Rush!!_card_artworks)
[OCG Forbidden & Limited Lists](https://yugipedia.com/wiki/Category:OCG_Forbidden_%26_Limited_Lists) was previously
downloaded into [`/wikitext/limit-regulation-ocg`](/wikitext/limit-regulation-ocg) but is no longer automatically
updating as it is not needed downstream. This could change as needed in the future.
## Adding a new category
1. Run the [download workflow](https://github.com/DawnbrandBots/yaml-yugipedia/actions/workflows/download.yml) with the URL-encoded title of the category page without the `Category:` as input, e.g. `Yu-Gi-Oh!_Master_Duel_Forbidden_%26_Limited_Lists`.
1. Add this URL-encoded category title to the [update list](/src/categories.txt) for the saved wikitexts automatically receive new changes via the [update workflow](https://github.com/DawnbrandBots/yaml-yugipedia/blob/master/.github/workflows/update.yml).
You can request to include a category by opening a pull request adding an entry to the [update list](/src/categories.txt).
## Semantic MediaWiki queries
- [Unreleased OCG, TCG, and Speed Duel cards](/semantic-mediawiki/unreleased.csv)
- [Unreleased Rush Duel cards](/semantic-mediawiki/unreleased-rush.csv)