{"id":15600701,"url":"https://github.com/osmlab/wmf-sitematrix","last_synced_at":"2025-06-14T19:04:53.040Z","repository":{"id":33580314,"uuid":"37226707","full_name":"osmlab/wmf-sitematrix","owner":"osmlab","description":"List of Wikimedia wikis","archived":false,"fork":false,"pushed_at":"2025-05-15T06:31:56.000Z","size":1007,"stargazers_count":6,"open_issues_count":2,"forks_count":3,"subscribers_count":30,"default_branch":"main","last_synced_at":"2025-05-15T07:31:04.460Z","etag":null,"topics":["iso-639","mediawiki","wikibooks","wikimedia","wikinews","wikipedia","wikiquote","wikisource","wikiversity","wikivoyage","wiktionary"],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/osmlab.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2015-06-10T22:47:47.000Z","updated_at":"2025-05-15T06:32:00.000Z","dependencies_parsed_at":"2023-01-15T01:30:52.470Z","dependency_job_id":"7f020f3b-b91b-44c8-8c35-8d68c3584756","html_url":"https://github.com/osmlab/wmf-sitematrix","commit_stats":{"total_commits":84,"total_committers":3,"mean_commits":28.0,"dds":"0.059523809523809534","last_synced_commit":"cc3186ed05708b84d7a905546b49fb33c08d8998"},"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"purl":"pkg:github/osmlab/wmf-sitematrix","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osmlab%2Fwmf-sitematrix","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osmlab%2Fwmf-sitematrix/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osmlab%2Fwmf-sitematrix/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osmlab%2Fwmf-sitematrix/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/osmlab","download_url":"https://codeload.github.com/osmlab/wmf-sitematrix/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osmlab%2Fwmf-sitematrix/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259868349,"owners_count":22924231,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["iso-639","mediawiki","wikibooks","wikimedia","wikinews","wikipedia","wikiquote","wikisource","wikiversity","wikivoyage","wiktionary"],"created_at":"2024-10-03T02:05:38.353Z","updated_at":"2025-06-14T19:04:53.010Z","avatar_url":"https://github.com/osmlab.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# WMF SiteMatrix\n\nThe goal of this project is to provide filtered versions of [Wikimedia's site matrix](https://meta.wikimedia.org/wiki/Special:SiteMatrix), as reported by the MediaWiki API in JSON format. Filtering allows Web applications like [iD](https://github.com/openstreetmap/iD) to avoid loading the entire matrix just to integrate with a single project, such as Wikipedia.\n\nThe data/ directory contains a prettified JSON file and a minified JSON file for each Wikimedia project. The all.json and all.min.json files include all the Wikimedia wikis, including not only the projects that have their own JSON files but also multilingual and special wikis.\n\nTo update the JSON files, run `make`.\n\n\n## Running on toolforge\nTo run on toolforge log into the tool accounnt:\n```\nssh myuser@login.toolforge.org\nmyuser@tools-sgebastion-10:$ become wmf-sitematrix\nwmf-sitematrix@tools-sgebastion-10:$\n```\n\nStart a build to pick up the new code\n```\nwmf-sitematrix@tools-sgebastion-10:$ toolforge build start https://github.com/osmlab/wmf-sitematrix\n... takes a minute\n```\n\n\nStart/restart the webservice mounting the NFS:\n```\nwmf-sitematrix@tools-sgebastion-10:$ toolforge webservice buildservice --mount=all restart\n```\n\nAnd create the job if it's not there to update `public_html/data/*json`:\n```\nwmf-sitematrix@tools-sgebastion-10:$ toolforge jobs run \\\n    --schedule '0 0 */15 * *' \\\n    --filelog \\\n    --mount=all \\\n    --image tool-wmf-sitematrix/tool-wmf-sitematrix:latest \\\n    --command 'update' \\\n    cron-tools.wmf-sitematrix-1\n```\n\nOr restart it if it exists and you want to run it right away:\n```\nwmf-sitematrix@tools-sgebastion-10:$ toolforge jobs restart cron-tools.wmf-sitematrix-1\n```\n\nOtherwise the next run will pull the new code.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fosmlab%2Fwmf-sitematrix","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fosmlab%2Fwmf-sitematrix","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fosmlab%2Fwmf-sitematrix/lists"}