{"id":22452034,"url":"https://github.com/woctezuma/egs-datamining","last_synced_at":"2025-08-02T00:32:35.439Z","repository":{"id":139782349,"uuid":"369582593","full_name":"woctezuma/egs-datamining","owner":"woctezuma","description":"Datamining of Epic Games Store (EGS).","archived":false,"fork":false,"pushed_at":"2024-11-14T17:13:47.000Z","size":695,"stargazers_count":3,"open_issues_count":2,"forks_count":0,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-04-08T10:51:36.491Z","etag":null,"topics":["datamining","egs","epic","epic-games","epic-games-launcher","epic-games-store","fortnite","games","games-list","metaverse","ranking"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/woctezuma.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2021-05-21T15:43:45.000Z","updated_at":"2025-03-17T15:49:08.000Z","dependencies_parsed_at":"2023-11-23T20:39:11.317Z","dependency_job_id":null,"html_url":"https://github.com/woctezuma/egs-datamining","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/woctezuma/egs-datamining","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fegs-datamining","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fegs-datamining/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fegs-datamining/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fegs-datamining/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/woctezuma","download_url":"https://codeload.github.com/woctezuma/egs-datamining/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/woctezuma%2Fegs-datamining/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":268317546,"owners_count":24231375,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-01T02:00:08.611Z","response_time":67,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["datamining","egs","epic","epic-games","epic-games-launcher","epic-games-store","fortnite","games","games-list","metaverse","ranking"],"created_at":"2024-12-06T06:09:35.853Z","updated_at":"2025-08-02T00:32:35.012Z","avatar_url":"https://github.com/woctezuma.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# EGS Data-Mining\n\n[![Build status with Github Action][build-image-action]][build-action]\n[![Code coverage][codecov-image]][codecov]\n[![Code Quality][codacy-image]][codacy]\n\nThis repository contains Python code to data-mine the Epic Games Store (EGS).\n\nThe workflow consists in:\n1.   listing namespaces associated with a known store page,\n2.   extracting codenames from the databases of `items` and `offers`,\n3.   filtering out codenames associated with a known store page,\n4.   listing one or several namespaces associated with each codename,\n5.   listing one or several `items` and `offers` associated with each namespace.\n\n## Requirements\n\n-   Install the latest version of [Python 3.X][python-download-url].\n-   Install the required packages:\n\n```bash\npip install -r requirements.txt\n```\n\n## Data acquisition\n\nTo download data from the trackers (at most once per day):\n\n```bash\npython download_data.py\n```\n\n## Usage\n\nTo figure out codenames of games for which the store page is not yet online:\n\n```bash\npython filter_codenames.py\n```\n\nThe output is shown in `data/outputs.json`\nas of May 21, 2021.\n\nThen one can look for hints of unreleased games by manually filtering entries with one of the codenames at:\n\n-   [the item tracker][item-tracker-url]\n-   [the offer tracker][offer-tracker-url]\n\n![Items and Offers, in order to check entries][generic-menu]\n\ne.g. with the codename `Angelfish` :\n\n![Filtering entries by codenames][generic-cover]\n\n## References\n\nData trackers:\n\n-   [items][item-tracker-github]\n-   [offers][offer-tracker-github]\n\nA few useful websites:\n-   [EGData][egdata-website]\n-   [EpicDataInfo][egdatabase-website]\n\nPress coverage:\n-   [PC Gamer][pcgamer-ff7r-awr]: \"Final Fantasy 7 Remake listing shows up on Epic Games Store database tracker\"\n-   [VGC][vgc-ff7r-awr]: \"Alan Wake Remastered and Final Fantasy 7 Remake listings spotted on the Epic Games Store’s database\"\n\n\u003c!-- Definitions --\u003e\n\n[build-action]: \u003chttps://github.com/woctezuma/egs-datamining/actions\u003e\n[build-image-action]: \u003chttps://github.com/woctezuma/egs-datamining/workflows/Python application/badge.svg?branch=main\u003e\n\n[codecov]: \u003chttps://codecov.io/gh/woctezuma/egs-datamining\u003e\n[codecov-image]: \u003chttps://codecov.io/gh/woctezuma/egs-datamining/branch/main/graph/badge.svg\u003e\n\n[codacy]: \u003chttps://www.codacy.com/gh/woctezuma/egs-datamining\u003e\n[codacy-image]: \u003chttps://api.codacy.com/project/badge/Grade/a2894131818947b9adba5e487a9a0413\u003e\n\n[generic-cover]: \u003chttps://github.com/woctezuma/egs-datamining/wiki/cover.png\u003e\n[generic-menu]: \u003chttps://github.com/woctezuma/egs-datamining/wiki/img/menu.png\u003e\n\n[item-tracker-url]: \u003chttps://database.egdata.app/items\u003e\n[offer-tracker-url]: \u003chttps://database.egdata.app/offers\u003e\n\n[python-download-url]: \u003chttps://www.python.org/downloads/\u003e\n\n[item-tracker-github]: \u003chttps://github.com/srdrabx/items-tracker\u003e\n[offer-tracker-github]: \u003chttps://github.com/srdrabx/offers-tracker\u003e\n\n[egdata-website]: \u003chttps://egdata.app/\u003e\n[egdatabase-website]: \u003chttps://database.egdata.app/\u003e\n\n[pcgamer-ff7r-awr]: \u003chttps://www.pcgamer.com/report-alan-wake-remastered-and-final-fantasy-7-remake-coming-to-the-epic-games-store/\u003e\n[vgc-ff7r-awr]: \u003chttps://www.videogameschronicle.com/news/alan-wake-remastered-and-final-fantasy-7-remake-listings-spotted-on-the-epic-games-stores-database/\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwoctezuma%2Fegs-datamining","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwoctezuma%2Fegs-datamining","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwoctezuma%2Fegs-datamining/lists"}