{"id":22364745,"url":"https://github.com/chrisyeh96/sustaingym","last_synced_at":"2026-01-06T02:52:29.469Z","repository":{"id":67423062,"uuid":"482997304","full_name":"chrisyeh96/sustaingym","owner":"chrisyeh96","description":"Reinforcement Learning Environments for Sustainable Energy Systems","archived":false,"fork":false,"pushed_at":"2024-05-31T21:49:23.000Z","size":138494,"stargazers_count":42,"open_issues_count":3,"forks_count":11,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-01-31T09:32:06.194Z","etag":null,"topics":["distribution-shift","energy-system","reinforcement-learning"],"latest_commit_sha":null,"homepage":"https://chrisyeh96.github.io/sustaingym/","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"cc-by-4.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/chrisyeh96.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-04-18T21:06:53.000Z","updated_at":"2024-12-13T08:15:20.000Z","dependencies_parsed_at":null,"dependency_job_id":"65483ba8-b550-492d-8b62-7f54bfc3d378","html_url":"https://github.com/chrisyeh96/sustaingym","commit_stats":{"total_commits":69,"total_committers":4,"mean_commits":17.25,"dds":0.05797101449275366,"last_synced_commit":"dd05501b6e3138875ff729d299ae3da53ac0e8bd"},"previous_names":[],"tags_count":7,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chrisyeh96%2Fsustaingym","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chrisyeh96%2Fsustaingym/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chrisyeh96%2Fsustaingym/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chrisyeh96%2Fsustaingym/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/chrisyeh96","download_url":"https://codeload.github.com/chrisyeh96/sustaingym/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245679313,"owners_count":20654807,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["distribution-shift","energy-system","reinforcement-learning"],"created_at":"2024-12-04T17:25:18.975Z","updated_at":"2026-01-06T02:52:29.441Z","avatar_url":"https://github.com/chrisyeh96.png","language":"HTML","funding_links":[],"categories":["Energy Systems"],"sub_categories":["Energy System Modeling Frameworks"],"readme":"# SustainGym: Reinforcement Learning Environments for Sustainable Energy Systems\n\nThe lack of standardized benchmarks for reinforcement learning (RL) in sustainability applications has made it difficult to both track progress on specific domains and identify bottlenecks for researchers to focus their efforts on. We present SustainGym, a suite of environments designed to test the performance of RL algorithms on realistic sustainability tasks. These environments highlight challenges in introducing RL to real-world sustainability tasks, including physical constraints and distribution shift.\n\n[**Paper**](https://openreview.net/forum?id=vZ9tA3o3hr)\n| [**Website**](https://chrisyeh96.github.io/sustaingym/)\n\nSustainGym contains both single-agent and multi-agent RL environments.\n- Single-agent environments follow the [Gymnasium API](https://gymnasium.farama.org/) and are designed to be easily used with the [StableBaselines3](https://stable-baselines3.readthedocs.io/) and [Ray RLLib](https://docs.ray.io/en/latest/rllib/) libraries for training RL algorithms.\n- Multi-agent environments follow the [PettingZoo Parallel API](https://pettingzoo.farama.org/api/parallel/) and are designed to be easily used with the [Ray RLLib](https://docs.ray.io/en/latest/rllib/) library for training multi-agent RL algorithms.\n\nPlease see the [SustainGym website](https://chrisyeh96.github.io/sustaingym/) for a getting started guide and complete documentation.\n\n\n## Folder structure\n\n```\ndocs/                   # website and documentation\nexamples/               # example code for running each environment\nsustaingym/             # main Python package\n    algorithms/\n        {env}/          # per-env algorithms\n    data/\n        moer/           # marginal carbon emission rates\n        {env}/          # per-env data files\n    envs/\n        {env}/          # per-env modules\ntests/                  # unit tests\n```\n\n## Contributing\n\nIf you would like to add a new environment, propose bug fixes, or otherwise contribute to SustainGym, please see the [Contributing Guide](CONTRIBUTING.md).\n\n## License\n\nSustainGym is released under a [Creative Commons Attribution 4.0 International Public License (CC BY 4.0)](https://creativecommons.org/licenses/by/4.0/). See the [LICENSE](LICENSE) file for the full terms.\n\n## Citation\n\nPlease cite SustainGym as\n\n\u003e C. Yeh, V. Li, R. Datta, J. Arroyo, N. Christianson, C. Zhang, Y. Chen, M. Hosseini, A. Golmohammadi, Y. Shi, Y. Yue, and A. Wierman, \"SustainGym: A Benchmark Suite of Reinforcement Learning for Sustainability Applications,\" in _Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track_, New Orleans, LA, USA, Dec. 2023. [Online]. Available: [https://openreview.net/forum?id=vZ9tA3o3hr](https://openreview.net/forum?id=vZ9tA3o3hr).\n\n\u003cdetails markdown=\"block\"\u003e\n\u003csummary\u003eBibTeX\u003c/summary\u003e\n\n```tex\n@inproceedings{yeh2023sustaingym,\n    title = {{SustainGym}: Reinforcement Learning Environments for Sustainable Energy Systems},\n    author = {Yeh, Christopher and Li, Victor and Datta, Rajeev and Arroyo, Julio and Zhang, Chi and Chen, Yize and Hosseini, Mehdi and Golmohammadi, Azarang and Shi, Yuanyuan and Yue, Yisong and Wierman, Adam},\n    year = 2023,\n    month = 12,\n    booktitle = {Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track},\n    address = {New Orleans, LA, USA},\n    url = {https://openreview.net/forum?id=vZ9tA3o3hr}\n}\n```\n\n\u003c/details\u003e\n\nAn earlier version of this work was published as a workshop paper:\n\n\u003e C. Yeh, V. Li, R. Datta, Y. Yue, and A. Wierman, \"SustainGym: A Benchmark Suite of Reinforcement Learning for Sustainability Applications,\" in _NeurIPS 2022 Workshop on Tackling Climate Change with Machine Learning_, Dec. 2022. [Online]. Available: [https://www.climatechange.ai/papers/neurips2022/38](https://www.climatechange.ai/papers/neurips2022/38).\n\n\u003cdetails markdown=\"block\"\u003e\n\u003csummary\u003eBibTeX\u003c/summary\u003e\n\n```tex\n@inproceedings{yeh2022sustaingym,\n    title = {{SustainGym}: A Benchmark Suite of Reinforcement Learning for Sustainability Applications},\n    author = {Yeh, Christopher and Li, Victor and Datta, Rajeev and Yue, Yisong and Wierman, Adam},\n    year = 2022,\n    month = 12,\n    booktitle = {NeurIPS 2022 Workshop on Tackling Climate Change with Machine Learning},\n    address = {New Orleans, LA, USA},\n    url = {https://www.climatechange.ai/papers/neurips2022/38}\n}\n```\n\n\u003c/details\u003e","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchrisyeh96%2Fsustaingym","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchrisyeh96%2Fsustaingym","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchrisyeh96%2Fsustaingym/lists"}