{"id":22452074,"url":"https://github.com/woctezuma/steam-filtered-image-data","last_synced_at":"2025-10-16T07:30:52.666Z","repository":{"id":54805983,"uuid":"316546010","full_name":"woctezuma/steam-filtered-image-data","owner":"woctezuma","description":"Build the Steam-OneFace dataset.","archived":false,"fork":false,"pushed_at":"2023-11-06T12:58:29.000Z","size":4219,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-08T22:23:24.782Z","etag":null,"topics":["data","image-dataset","image-datasets","steam","steam-api","steam-game","steam-games","steam-oneface"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/woctezuma.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-11-27T16:08:29.000Z","updated_at":"2022-07-25T12:59:07.000Z","dependencies_parsed_at":"2022-08-14T03:20:57.723Z","dependency_job_id":null,"html_url":"https://github.com/woctezuma/steam-filtered-image-data","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/woctezuma/steam-filtered-image-data","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fsteam-filtered-image-data","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fsteam-filtered-image-data/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fsteam-filtered-image-data/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fsteam-filtered-image-data/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/woctezuma","download_url":"https://codeload.github.com/woctezuma/steam-filtered-image-data/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fsteam-filtered-image-data/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279165667,"owners_count":26117911,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-16T02:00:06.019Z","response_time":53,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","image-dataset","image-datasets","steam","steam-api","steam-game","steam-games","steam-oneface"],"created_at":"2024-12-06T06:09:43.298Z","updated_at":"2025-10-16T07:30:52.209Z","avatar_url":"https://github.com/woctezuma.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Steam Filtered Image Data\n\nThis repository provides details about image data:\n-   downloaded from Steam,\n-   **filtered** following parts of the procedure in [`download-steam-banners-data`][download-steam-banners-data].\n\nA dataset, called Steam-OneFace, is shared [in this section][steam-oneface-section].\n\n## Data\n\nData downloaded from Steam consists of:\n-   PNG logos with transparency,\n-   JPG vertical banners.\n\nFiltered image data is shared [on Google Drive][filtered-data-on-gdrive].\n\nThe *up-to-date* list of appIDs for which I have *tried* to download image data is available in:\n\u003e `data/download-queries/app_ids.txt`. Most of these ~48k appIDs do not feature any image data.\n\nHere is an example of a vertical banner:\n\n![Example of a vertical Banner][vertical-banner-example]\n\nHere is an example of a logo:\n\n![Example of a logo][logo-example]\n\n## Filtering\n\nThe filtering consists in the removal of:\n-   blank images, i.e. images for which grayscale image intensity extrema are equal,\n-   images of uncommon resolution:\n    - anything but 640x360 for logos,\n    - anything but 300x450 for vertical banners,\n-   images with uncommon bands:\n    - anything but RGBA for logos,\n    - anything but RGB for banners,\n-   images for which the bounding box of the non-zero regions covers:\n    - 100% of the image space for transparent logos,\n    - strictly less than 100% image space for banners, which happens with [vignetting][vignetting-wiki].\n\n## Suggestions of filtering\n\nSuggestions of filtering include:\n-   removal of duplicate images with [`imagededup`][imagededup],\n-   filtering based on the number of detected faces, as in [`steam-face-detection`][steam-face-detection].\n\nThe enforcement of such filtering is left to the reader.\nOtherwise, it would be difficult to keep **filtered** data up-to-date.\n\n## Steam-OneFace dataset\n\nThe notebook [`build_steam_oneface_dataset.ipynb`][steam-oneface-notebook] shows an application of the filters suggested above.\n[![Open In Colab][colab-badge]][steam-oneface-notebook]\n\nThere are three options for the face detector:\n-   [`face-alignment`][python-face-alignment]\n-   [`retinaface_pytorch`][retinaface]\n-   [`dlib`][dlib-github]\n\n### With the `face_alignment` module\n\nThis allows to build a dataset, called `Steam-OneFace`, of 1688 images which should all feature exactly one face.\n\nThis dataset is shared [on Google Drive][steam-oneface-gdrive] in:\n-   the original resolution (300x450): [`steam-oneface-hr.tar.gz`][steam-oneface-hr] (94 MB)\n-   a lower resolution (256x256): [`steam-oneface-lr.tar.gz`][steam-oneface-lr] (52 MB)\n\n[![Thumbnails of Steam OneFace][steam-oneface-cover-small]][steam-oneface-cover-big]\n\nTo use this dataset on Google Colab, run the following:\n```bash\n!gdown --id 1QptHrW9vloTtP--YJsxMY8PZWI2D8NJt\n!tar xf steam-oneface-lr.tar.gz\n```\n```python\nimport glob\nfrom pathlib import Path\n\nfile_names = glob.glob('steam-oneface-lr/*.jpg')\napp_ids = [int(Path(fname).stem) for fname in file_names]\n```\n\n### With the `retinaface` module\n\nThe dataset consists of 2472 images, shared in:\n-   the original resolution (300x450): [`steam-oneface-hr_with_retinaface.tar.gz`][steam-oneface-hr-retinaface] (133 MB)\n-   a lower resolution (256x256): [`steam-oneface-lr_with_retinaface.tar.gz`][steam-oneface-lr-retinaface] (74 MB)\n\nTo use this dataset on Google Colab, run the following:\n```bash\n!gdown --id 1-0Nk7H6Cn3Nt60EdHG_NWSA8ohi2oBqr\n!tar xf steam-oneface-lr_with_retinaface.tar.gz\n```\n\n### With the `dlib` module\n\nThe dataset consists of 305 images, shared in:\n-   the original resolution (300x450): [`steam-oneface-hr_with_dlib.tar.gz`][steam-oneface-hr-dlib] (16 MB)\n-   a lower resolution (256x256): [`steam-oneface-lr_with_dlib.tar.gz`][steam-oneface-lr-dlib] (9 MB)\n\nTo use this dataset on Google Colab, run the following:\n```bash\n!gdown --id 1-4RIn9G9Bee2JZ1bK1gkkgkLocHuWJJ4\n!tar xf steam-oneface-lr_with_dlib.tar.gz\n```\n\n### With several detection modules\n\nThe notebook [`trim_steam_oneface_dataset.ipynb`][steam-oneface-notebook-trim] trims the dataset by intersecting the results of different detectors.\n[![Open In Colab][colab-badge]][steam-oneface-notebook-trim]\n\nThe trimmed datasets are:\n\n#### Steam-OneFace-small\n\n-   [`Steam-OneFace-small`][steam-oneface-small-gdrive]:\n    - 993 images,\n    - obtained with modules `face_alignment` and `retinaface`,\n\nTo use this dataset on Google Colab, run the following:\n```bash\n!gdown --id 1-1V5fDhPo75iDtAbrD18rppV-lf51bPW\n!tar xf steam-oneface-small-lr.tar.gz\n```\n\n#### Steam-OneFace-tiny\n\n-   [`Steam-OneFace-tiny`][steam-oneface-tiny-gdrive]:\n    - 168 images,\n    - obtained with modules `dlib`, `face_alignment` and `retinaface`.\n\nTo use this dataset on Google Colab, run the following:\n```bash\n!gdown --id 1-2sCVgBUmu6LFug1pzBfmL8zNFFBq27F\n!tar xf steam-oneface-tiny-lr.tar.gz\n```\n\n![Thumbnails of the WHOLE dataset Steam OneFace Tiny][steam-oneface-tiny-as-grid]\n\n## References\n\n-   To download images: [`download_steam_banners.ipynb`][download_steam_banners] in [`woctezuma/google-colab`][code]\n-   To filter out duplicates, etc.:\n    - for PNG logos: [`remove_duplicates.ipynb`][filter_steam_logos] in [`woctezuma/google-colab`][code]\n    - for JPG banners: [`remove_duplicates.ipynb`][filter_steam_banners] in [`woctezuma/steam-stylegan2-ada`][code-ada]\n-   To detect faces: [`detect_faces_on_steam_banners.ipynb`][colab-notebook-face-detection] in [`woctezuma/steam-face-detection`][steam-face-detection]\n\n\n\u003c!-- Definitions --\u003e\n\n[download-steam-banners-data]: \u003chttps://github.com/woctezuma/download-steam-banners-data\u003e\n[steam-oneface-section]: \u003chttps://github.com/woctezuma/steam-filtered-image-data#steam-oneface-dataset\u003e\n\n[logo-example]: \u003chttps://cdn.cloudflare.steamstatic.com/steam/apps/546560/logo.png\u003e\n[vertical-banner-example]: \u003chttps://cdn.cloudflare.steamstatic.com/steam/apps/546560/library_600x900.jpg\u003e\n\n[filtered-data-on-gdrive]: \u003chttps://drive.google.com/drive/folders/1SHb7u_mZZ0fDy2lDQ7d94E79os_OYH2z\u003e\n\n[vignetting-wiki]: \u003chttps://en.wikipedia.org/wiki/Vignetting\u003e\n\n[imagededup]: \u003chttps://idealo.github.io/imagededup/\u003e\n[steam-face-detection]: \u003chttps://github.com/woctezuma/steam-face-detection\u003e\n\n[steam-oneface-notebook]: \u003chttps://colab.research.google.com/github/woctezuma/steam-filtered-image-data/blob/main/build_steam_oneface_dataset.ipynb\u003e\n[dlib-github]: \u003chttps://github.com/davisking/dlib\u003e\n[python-face-alignment]: \u003chttps://github.com/1adrianb/face-alignment\u003e\n[retinaface]: \u003chttps://github.com/ternaus/retinaface\u003e\n[steam-oneface-gdrive]: \u003chttps://drive.google.com/drive/folders/1MlpNk6PwYZWhJegMjuukcYCNFSnXR3wg\u003e\n[steam-oneface-hr]: \u003chttps://drive.google.com/file/d/1dmm1W8kPINVQrG8NbxXw_KEgU2Nkeksu\u003e\n[steam-oneface-lr]: \u003chttps://drive.google.com/file/d/1QptHrW9vloTtP--YJsxMY8PZWI2D8NJt\u003e\n[steam-oneface-cover-small]: \u003chttps://raw.githubusercontent.com/wiki/woctezuma/steam-filtered-image-data/img/oneface-cover-small.jpg\u003e\n[steam-oneface-cover-big]: \u003chttps://raw.githubusercontent.com/wiki/woctezuma/steam-filtered-image-data/img/oneface-cover.jpg\u003e\n[steam-oneface-hr-retinaface]: \u003chttps://drive.google.com/file/d/1-04pq-vVnEU5T083DkeLmdRxP2dnQ4Vb\u003e\n[steam-oneface-lr-retinaface]: \u003chttps://drive.google.com/file/d/1-0Nk7H6Cn3Nt60EdHG_NWSA8ohi2oBqr\u003e\n[steam-oneface-hr-dlib]: \u003chttps://drive.google.com/file/d/1-4_-d8ClSCRzuULEVgV8gvjQHKkz0WuK\u003e\n[steam-oneface-lr-dlib]: \u003chttps://drive.google.com/file/d/1-4RIn9G9Bee2JZ1bK1gkkgkLocHuWJJ4\u003e\n\n[steam-oneface-notebook-trim]: \u003chttps://colab.research.google.com/github/woctezuma/steam-filtered-image-data/blob/main/trim_steam_oneface_dataset.ipynb\u003e\n[steam-oneface-small-gdrive]: \u003chttps://drive.google.com/drive/folders/1jSCyxmthOoFQjUEfwRXNUT7Ap9oU8kY_\u003e\n[steam-oneface-tiny-gdrive]: \u003chttps://drive.google.com/drive/folders/1Godpyq52rfrs8CXdSFzSt_CLErucYf6Z\u003e\n[steam-oneface-tiny-as-grid]: \u003chttps://raw.githubusercontent.com/wiki/woctezuma/steam-filtered-image-data/img/steam-oneface-tiny-hr-grid-quality_20.jpg\u003e\n\n[colab-badge]: \u003chttps://colab.research.google.com/assets/colab-badge.svg\u003e\n\n[code]: \u003chttps://github.com/woctezuma/google-colab\u003e\n[code-ada]: \u003chttps://github.com/woctezuma/steam-stylegan2-ada\u003e\n[download_steam_banners]: \u003chttps://colab.research.google.com/github/woctezuma/google-colab/blob/master/download_steam_banners.ipynb\u003e\n[filter_steam_logos]: \u003chttps://colab.research.google.com/github/woctezuma/google-colab/blob/master/remove_duplicates.ipynb\u003e\n[filter_steam_banners]: \u003chttps://colab.research.google.com/github/woctezuma/steam-stylegan2-ada/blob/main/remove_duplicates.ipynb\u003e\n[colab-notebook-face-detection]: \u003chttps://colab.research.google.com/github/woctezuma/steam-face-detection/blob/main/detect_faces_on_steam_banners.ipynb\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwoctezuma%2Fsteam-filtered-image-data","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwoctezuma%2Fsteam-filtered-image-data","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwoctezuma%2Fsteam-filtered-image-data/lists"}