{"id":24956158,"url":"https://github.com/iragca/anilist-data-transfer","last_synced_at":"2026-05-05T08:35:33.107Z","repository":{"id":271798757,"uuid":"914597654","full_name":"iragca/Anilist-Data-Transfer","owner":"iragca","description":"This repository is for transferring/migrating data from the node based AniList GraphQL database to a local DuckDB relational database. The anime entries retrieved are roughly ~13,000 rows as of 2025 January 10.","archived":false,"fork":false,"pushed_at":"2025-01-11T01:32:19.000Z","size":5211,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-28T20:16:50.692Z","etag":null,"topics":["anilist","anilist-api","anime","data-science","dataset","duckdb","graphql","python","requests-library-python"],"latest_commit_sha":null,"homepage":"https://iragca.github.io/Anilist-Data-Transfer/","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/iragca.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-01-09T23:02:24.000Z","updated_at":"2025-01-14T14:25:46.000Z","dependencies_parsed_at":"2025-01-10T00:25:41.313Z","dependency_job_id":"2f432d26-ee9b-478b-9bb5-7f6d9cc178ac","html_url":"https://github.com/iragca/Anilist-Data-Transfer","commit_stats":null,"previous_names":["iragca/anilist-data-transfer"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iragca%2FAnilist-Data-Transfer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iragca%2FAnilist-Data-Transfer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iragca%2FAnilist-Data-Transfer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iragca%2FAnilist-Data-Transfer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/iragca","download_url":"https://codeload.github.com/iragca/Anilist-Data-Transfer/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246093182,"owners_count":20722403,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["anilist","anilist-api","anime","data-science","dataset","duckdb","graphql","python","requests-library-python"],"created_at":"2025-02-03T06:27:44.835Z","updated_at":"2026-05-05T08:35:33.076Z","avatar_url":"https://github.com/iragca.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=\"center\"\u003eAnilist Data Transfer\u003c/h1\u003e\n\u003ch3 align=\"center\"\u003ePart of \u003ca href=\"https://github.com/iragca/keikakku-dashboards\"\u003eKeikakku Dashboards\u003c/a\u003e\u003c/h3\u003e\n\n\u003ch3\u003eQuicklinks\u003c/h3\u003e\n\n- [Getting Started](#Getting-Started)\n- [Exploratory Data Analysis](#EDA)\n\n  \u003ch2\u003e\u003c/h2\u003e\n\nThis repository is for transferring data from the node based [AniList GraphQL database](https://docs.anilist.co/) to\na local DuckDB relational database. The anime entries retrieved are roughly ~13,000 rows as of 2025 January 10.\n\n\u003e AniList database -\u003e GraphQL API -\u003e DuckDB\n\n8 tables currently exist in the database:\n\n- **Anime:** Stores detailed information about the anime shows.\n- **Review:** Stores reviews of anime.\n- **Status:** Stores statistics about anime user statuses.\n- **User:** Stores user information.\n- **WebAsset:** Stores web assets related to anime.\n- **Studio:** Stores information about studios associated with anime.\n- **Tag:** Stores tags associated with anime.\n- **Genre:** Stores genres associated with anime.\n\n\u003e [!NOTE]\n\u003e Primary keys are for enforcing uniqueness. Foreign keys are not recommended as GraphQL is inherently node based and not relational.\n\n#### Relevant / Similar Repositories\n\n- https://github.com/manami-project/anime-offline-database\n\n## \u003ca id=\"Getting-Started\"\u003e\u003c/a\u003eGetting Started\n\n\nhttps://github.com/user-attachments/assets/7a25466b-d1a9-4c4f-8259-7d8bf6b89396\n\n\nRequirements:\n\n- Python\n\n\n\u003cdiv style=\"font-weight: bold; margin-bottom: 5px;\"\u003eLinux\u003c/div\u003e\n\n```bash\ngit clone https://github.com/iragca/anilist-data-transfer.git\ncd anilist-data-transfer\nbash setup.sh\nsource .venv/bin/activate\npip install -r requirements.txt\npython src/init_db.py\npython src/data_transfer.py 1940 2025 10 # \u003cinclusive: start year\u003e \u003cexclusive: end year\u003e \u003coptional: cooldown; default: 10\u003e\n```\n\n\u003cdiv style=\"font-weight: bold; margin-bottom: 5px;\"\u003ePowershell\u003c/div\u003e\n\n```powershell\ngit clone https://github.com/iragca/anilist-data-transfer.git\ncd anilist-data-transfer\npip install virtualenv\nvirtualenv .venv\nsource .\\.venv\\Scripts\\activate\npip install -r requirements.txt\npython .\\src\\init_db.py\npython .\\src\\data_transfer.py 1940 2025 10 # \u003cinclusive: start year\u003e \u003cexclusive: end year\u003e \u003coptional: cooldown; default: 10\u003e\n```\n\n## \u003ca id=\"EDA\"\u003e\u003c/a\u003eExploratory Data Analysis\n\nBasic reports are made for each table and are available on project folder [root/eda](https://github.com/iragca/Anilist-Data-Transfer/tree/main/eda)\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Firagca%2Fanilist-data-transfer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Firagca%2Fanilist-data-transfer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Firagca%2Fanilist-data-transfer/lists"}