{"id":26577237,"url":"https://github.com/asahi417/wikiart-image-dataset","last_synced_at":"2025-07-19T06:04:50.559Z","repository":{"id":46662366,"uuid":"434890852","full_name":"asahi417/wikiart-image-dataset","owner":"asahi417","description":"We release WikiART Crawler, a python-library to download/process images from WikiART via WikiART API, and two image datasets: `WikiART Face` and `WikiART General`.","archived":false,"fork":false,"pushed_at":"2024-03-29T00:37:50.000Z","size":32966,"stargazers_count":55,"open_issues_count":0,"forks_count":3,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-09T00:41:30.366Z","etag":null,"topics":["art","computer-vision","dataset","generative-model"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/asahi417.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2021-12-04T12:07:42.000Z","updated_at":"2025-03-23T03:59:29.000Z","dependencies_parsed_at":"2024-03-28T15:49:33.446Z","dependency_job_id":"829b8ed5-464d-449e-bc50-cc4f62e4be3f","html_url":"https://github.com/asahi417/wikiart-image-dataset","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/asahi417/wikiart-image-dataset","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asahi417%2Fwikiart-image-dataset","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asahi417%2Fwikiart-image-dataset/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asahi417%2Fwikiart-image-dataset/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asahi417%2Fwikiart-image-dataset/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/asahi417","download_url":"https://codeload.github.com/asahi417/wikiart-image-dataset/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/asahi417%2Fwikiart-image-dataset/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265895968,"owners_count":23845414,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["art","computer-vision","dataset","generative-model"],"created_at":"2025-03-23T03:36:58.902Z","updated_at":"2025-07-19T06:04:50.537Z","avatar_url":"https://github.com/asahi417.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# WikiART Face/WikiART General Imageset \u0026 WikiART Crawler\n\n\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"assets/wikiart_face_image.png\" width=\"650\"\u003e\u003cbr\u003e\n\u003cem\u003eFigure 1: Samples from WikiART Face dataset.\u003c/em\u003e\n\u003c/p\u003e\n\n***News:*** WikiART Face is available in huggingface. Check the repo at [asahi417/wikiart_face](https://huggingface.co/datasets/asahi417/wikiart_face).\n\nThis is a repository for [***WikiART Crawler***](#wikiart-crawler), a python-library to download/process images from\n[WikiART](https://www.wikiart.org/) via WikiART API. We also have released following two image datasets created \nwith the WikiART Crawler.\n\n- [***WikiART Face***](#wikiart-face): Facial image dataset extracted from the portraits obtained via WikiART Crawler. \n- [***WikiART General***](#wikiart-general): Image dataset of paintings (landscape and portrait) obtained via WikiART Crawler.\n\nThe datasets can be used via [WikiART Crawler](#wikiart-crawler) that allows fine-grained control of the dataset. \nOr check [dataset links section](#dataset-links) to directly download the zip files. \n\n### WikiART Face\n\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"assets/face_image_pipeline.png\" width=\"700\"\u003e\u003cbr\u003e\n\u003cem\u003eFigure 2: Pipeline to produce single WikiART Face image.\u003c/em\u003e\n\u003c/p\u003e\n\nWikiART Face is a collection of face from paintings. Inspired by the largest human-face image set [CelebA](https://mmlab.ie.cuhk.edu.hk/projects/CelebA.html),\nwe process all the portraits from WikiART with the pipeline described in Figure 2. \nAs the final step, we blur the corner of each image so that model can pay more attention on the face rather than the background.\nWe release both version of the dataset w/wo the final blur step.\nBelow table shows the image size per each art movement. The dataset is available on huggingface (see [here](https://huggingface.co/datasets/asahi417/wikiart_face))\n\n|  Art Movement              |   WikiART Face |\n|:---------------------------|---------------:|\n| abstract-expressionism     |             22 |\n| baroque                    |             17 |\n| ecole-de-paris             |            228 |\n| expressionism              |            649 |\n| impressionism              |          1,166 |\n| naive-art-primitivism      |             72 |\n| neo-impressionism          |             41 |\n| neoclassicism              |            607 |\n| post-impressionism         |            474 |\n| pre-raphaelite-brotherhood |            103 |\n| realism                    |          1,625 |\n| rococo                     |          1,030 |\n| romanticism                |          1,502 |\n| surrealism                 |             78 |\n| symbolism                  |            571 |\n| All                        |          6,095 |\n\n### WikiART General\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"assets/wikiart_general.png\" width=\"900\"\u003e \u003cbr\u003e\n\u003cem\u003e Figure 3: Samples from WikiART General. \u003c/em\u003e\n\u003c/p\u003e\n\nWikiART General is an image set of artwork image attained from WikiART via our WikiART Crawler. We normalize the image size to be 256 x 256 by center crop.\nFigure 3 shows sample images for portrait, landscape, and the other style.\nBelow table shows the image size per each art movement and the painting style.\n\n|   Art Movement             |   WikiART General |   WikiART General/Portrait |   WikiART General/Landscape |   WikiART General/Other |\n|:---------------------------|------------------:|---------------------------:|----------------------------:|------------------------:|\n| abstract-expressionism     |               706 |                         30 |                          25 |                     651 |\n| baroque                    |               160 |                         10 |                           5 |                     145 |\n| ecole-de-paris             |               842 |                        384 |                          68 |                     390 |\n| expressionism              |              1,783 |                        573 |                         166 |                    1,044 |\n| impressionism              |              6,830 |                       1,675 |                        1,985 |                    3,170 |\n| naive-art-primitivism      |               360 |                         75 |                          25 |                     260 |\n| neo-impressionism          |              1,129 |                         99 |                         481 |                     549 |\n| neoclassicism              |              1,406 |                        761 |                          65 |                     580 |\n| post-impressionism         |              3,699 |                        565 |                        1,069 |                    2,065 |\n| pre-raphaelite-brotherhood |               410 |                        119 |                          10 |                     281 |\n| realism                    |              5,648 |                       1,736 |                        1,239 |                    2,673 |\n| rococo                     |              1,691 |                        883 |                          41 |                     767 |\n| romanticism                |              4,305 |                       1,081 |                         855 |                    2,369 |\n| surrealism                 |               612 |                         67 |                          78 |                     467 |\n| symbolism                  |              2,703 |                        381 |                         657 |                    1,665 |\n| All                        |             25,612 |                       6,126 |                        5,872 |                   13,614 |\n\n## WikiART Crawler\nFirst clone/install the library.\n```shell\ngit clone https://github.com/asahi417/wikiart-image-dataset\ncd wikiart-image-dataset\npip install .\n```\n\nThe basic usage is to specify a single artist and get the file paths of the artist's image downloaded locally at the first time\n(the cache directory is `~/.cache/wikiartcrawler` as default).\n\n```python\nfrom wikiartcrawler import WikiartAPI\napi = WikiartAPI()\n# get Paul Cezanne's image\nimage_path = api.get_painting('paul-cezanne', media=['canvas', 'oil'])\n# get portrait only \nimage_path_portrait = api.get_painting('paul-cezanne', media=['canvas', 'oil'], style=['portrait'])\n# get landscape only \nimage_path_landscape = api.get_painting('paul-cezanne', media=['canvas', 'oil'], style=['landscape'])\n```\n\nTo see all the alias of artist name in the API, \n```python\nfrom wikiartcrawler import artist_group\nprint(artist_group.available_artist())\n```\n\nYou can use art movement to group the artist\n\n```python\nfrom wikiartcrawler import WikiartAPI, get_artist\napi = WikiartAPI()\n# list of artist alias related to the art movement\nartist_group = get_artist('impressionism') \n# collect all the image file from each artist in the art movement\nfiles = []\nfor artist in artist_group:\n  tmp = api.get_painting(artist)\n  if tmp is not None:\n    files += tmp\n```\n\nThe availabe art movements are `abstract-expressionism`, `baroque`, `ecole-de-paris`, `expressionism`, \n`impressionism`, `naive-art-primitivism`, `neo-impressionism`, `neoclassicism`, `post-impressionism`, \n`pre-raphaelite-brotherhood`, `realism`, `rococo`, `romanticism`, `surrealism`, and `symbolism`.\n\n### Use WikiART Face\nTo use WikiART Face image, you need to specify it by the `image_type` argument.\n\n```python\nfrom wikiartcrawler import WikiartAPI, get_artist, available_artist\napi = WikiartAPI()\n# WikiArt Face  \nimage_path = api.get_painting('paul-cezanne', image_type='face')\n# WikiArt Face (with background blur)\nimage_path = api.get_painting('paul-cezanne', image_type='face_blur')\n\n# Get all WikiArt Face Image\nfiles_all = []\nfor a in available_artist():\n  tmp = api.get_painting(a, image_type='face_blur')\n  if tmp is not None:\n    files_all += tmp\n\n# Get WikiArt Face Image only for some art movements\nfiles = []\nartists = get_artist(['post-impressionism', 'impressionism', 'neo-impressionism'])\nfor a in artists:\n  tmp = api.get_painting(a, image_type='face_blur')\n  if tmp is not None:\n    files += tmp\n```\n\nTo reproduce the entire WikiArt Face image set, you can check [these scripts](./examples/generate_face_data).\n\n## Dataset Links\n- ***WikiArt General***: The image files are divided by each art movement.\n    * [abstract-expressionism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/abstract_expressionism.zip)\n    * [baroque](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/baroque.zip)\n    * [ecole-de-paris](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/ecole_de_paris.zip)\n    * [expressionism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/expressionism.zip)\n    * [impressionism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/impressionism.zip)\n    * [naive-art-primitivism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/naive_art_primitivism.zip)\n    * [neo-impressionism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/neo_impressionism.zip)\n    * [neoclassicism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/neoclassicism.zip)\n    * [post-impressionism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/post_impressionism.zip)\n    * [pre-raphaelite-brotherhood](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/pre_raphaelite_brotherhood.zip)\n    * [realism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/realism.zip)\n    * [rococo](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/rococo.zip)\n    * [romanticism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/romanticism.zip)\n    * [surrealism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/surrealism.zip)\n    * [symbolism](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/symbolism.zip)\n- ***WikiArt Face***\n  * [wikiart face](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/image_face.zip)\n  * [wikiart face (with background blur)](https://github.com/asahi417/wikiart-crawler/releases/download/v0.0.0/image_face_blur.zip)\n  \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fasahi417%2Fwikiart-image-dataset","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fasahi417%2Fwikiart-image-dataset","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fasahi417%2Fwikiart-image-dataset/lists"}