https://github.com/marvnc/pixiv-dump

Pixiv Encyclopedia DB Dumps, updated daily
https://github.com/marvnc/pixiv-dump

crawler database dump encyclopedia japanese pixiv pixiv-crawler pixiv-database scraping

Last synced: 11 days ago
JSON representation

Pixiv Encyclopedia DB Dumps, updated daily

• Host: GitHub
• URL: https://github.com/marvnc/pixiv-dump
• Owner: MarvNC
• Created: 2024-02-08T08:19:16.000Z (9 months ago)
• Default Branch: master
• Last Pushed: 2024-04-13T00:53:04.000Z (7 months ago)
• Last Synced: 2024-04-14T00:39:01.619Z (7 months ago)
• Topics: crawler, database, dump, encyclopedia, japanese, pixiv, pixiv-crawler, pixiv-database, scraping
• Language: TypeScript
• Homepage:
• Size: 140 KB
• Stars: 2
• Watchers: 0
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# Pixiv Encyclopedia Dump

This repository contains dumps of the

[Pixiv Encyclopedia](https://dic.pixiv.net/) (ピクシブ百科事典), a collection of

articles on various topics, including anime, manga, and games. The articles are

written by users and are available in Japanese.

A Yomitan dictionary built with this data can be found at

[pixiv-yomitan](https://github.com/MarvNC/pixiv-yomitan).

## Download

The dumps are available in the

[releases](https://github.com/MarvNC/pixiv-dump/releases) section.

## Format

The dumps are available as sqlite3 databases. The detailed schema can be found

in the [schema.prisma](./prisma/schema.prisma) file.

```prisma

model PixivArticle {

  tag_name           String  @id

  summary            String

  updated_at         String

  main_illst_url     String

  view_count         Int

  illust_count       Int

  check_count        Int

  related_tags       String

  parent             String?

  lastScraped        String

  reading            String?

  header             String?

  mainText           String?

  lastScrapedReading String? // Unused

  lastScrapedArticle String?

}

```