{"id":19777176,"url":"https://github.com/ppy/osu-performance-datasets-generator","last_synced_at":"2026-01-05T23:30:53.307Z","repository":{"id":50265873,"uuid":"511967675","full_name":"ppy/osu-performance-datasets-generator","owner":"ppy","description":null,"archived":false,"fork":false,"pushed_at":"2024-04-04T16:54:52.000Z","size":26,"stargazers_count":2,"open_issues_count":1,"forks_count":1,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-01-31T13:25:06.751Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ppy.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-07-08T17:00:13.000Z","updated_at":"2023-01-08T01:05:36.000Z","dependencies_parsed_at":"2024-11-12T05:35:02.422Z","dependency_job_id":null,"html_url":"https://github.com/ppy/osu-performance-datasets-generator","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ppy%2Fosu-performance-datasets-generator","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ppy%2Fosu-performance-datasets-generator/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ppy%2Fosu-performance-datasets-generator/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ppy%2Fosu-performance-datasets-generator/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ppy","download_url":"https://codeload.github.com/ppy/osu-performance-datasets-generator/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245650484,"owners_count":20650105,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-12T05:23:30.188Z","updated_at":"2026-01-05T23:30:53.263Z","avatar_url":"https://github.com/ppy.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# osu-performance-datasets-generator [![dev chat](https://discordapp.com/api/guilds/188630481301012481/widget.png?style=shield)](https://discord.gg/ppy)\n\nSet of scripts generating SQL and .osu dumps from production for osu-performance developers to use locally.\n\nThese scripts are for internal use only. Please find the dumps on https://data.ppy.sh.\n\n# Usage\n\nRun `./dump_all.sh` monthly with the following environment variables:\n- beatmaps S3 bucket: `OSU_DOWNLOAD_AWS_ACCESS_KEY_ID`, `OSU_DOWNLOAD_AWS_SECRET_ACCESS_KEY`, `OSU_DOWNLOAD_S3_BUCKET`, `OSU_DOWNLOAD_S3_ENDPOINT`\n- data.ppy.sh S3 bucket: `DUMPS_UPLOAD_AWS_ACCESS_KEY_ID`, `DUMPS_UPLOAD_AWS_SECRET_ACCESS_KEY`, `DUMPS_UPLOAD_S3_BUCKET`, `DUMPS_UPLOAD_S3_ENDPOINT`, `DUMPS_UPLOAD_S3_ACL` (optional)\n- osu! database: `DATABASE_HOST`, `DATABASE_USER`, `DATABASE_PASSWORD` (optional)\n\nFor DigitalOcean Spaces support, `DUMPS_UPLOAD_S3_ENDPOINT` and `DUMPS_UPLOAD_S3_ACL` need different values, eg `DUMPS_UPLOAD_S3_ENDPOINT=https://nyc3.digitaloceanspaces.com` and `DUMPS_UPLOAD_S3_ACL=public-read`.\n\nFor s3-nginx-proxy purge support, `DUMPS_UPLOAD_S3_PUBLIC_URL` and `DUMPS_UPLOAD_S3_PURGE_AUTHORIZATION_KEY` need to be set (optional).\n\n~16GB of free disk space is recommended (estimated).\n\n# Contributing\n\nContributions can be made via pull requests to this repository. We hope to credit and reward larger contributions via a [bounty system](https://www.bountysource.com/teams/ppy). If you're unsure of what you can help with, check out the [list of open issues](https://github.com/ppy/osu-performance-datasets-generator/issues).\n\nNote that while we already have certain standards in place, nothing is set in stone. If you have an issue with the way code is structured; with any libraries we are using; with any processes involved with contributing, *please* bring it up. I welcome all feedback so we can make contributing to this project as pain-free as possible.\n\n# Licence\n\nThe osu! client code, framework, and server-side components are licensed under the [MIT licence](https://opensource.org/licenses/MIT). Please see [the licence file](LICENCE) for more information. [tl;dr](https://tldrlegal.com/license/mit-license) you can do whatever you want as long as you include the original copyright and license notice in any copy of the software/source.\n\nPlease note that this *does not cover* the usage of the \"osu!\" or \"ppy\" branding in any software, resources, advertising or promotion, as this is protected by trademark law.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fppy%2Fosu-performance-datasets-generator","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fppy%2Fosu-performance-datasets-generator","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fppy%2Fosu-performance-datasets-generator/lists"}