{"id":20075662,"url":"https://github.com/catalyst-team/catalyst-rl","last_synced_at":"2025-05-05T21:33:19.484Z","repository":{"id":62561000,"uuid":"247928934","full_name":"catalyst-team/catalyst-rl","owner":"catalyst-team","description":null,"archived":false,"fork":false,"pushed_at":"2021-09-13T05:59:12.000Z","size":354,"stargazers_count":47,"open_issues_count":4,"forks_count":7,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-04-19T14:30:27.316Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/catalyst-team.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-03-17T09:29:13.000Z","updated_at":"2025-02-26T06:38:20.000Z","dependencies_parsed_at":"2022-11-03T15:00:26.691Z","dependency_job_id":null,"html_url":"https://github.com/catalyst-team/catalyst-rl","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/catalyst-team%2Fcatalyst-rl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/catalyst-team%2Fcatalyst-rl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/catalyst-team%2Fcatalyst-rl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/catalyst-team%2Fcatalyst-rl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/catalyst-team","download_url":"https://codeload.github.com/catalyst-team/catalyst-rl/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251558501,"owners_count":21608832,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-13T15:00:22.185Z","updated_at":"2025-05-05T21:33:14.616Z","avatar_url":"https://github.com/catalyst-team.png","language":"Python","readme":"\u003cdiv align=\"center\"\u003e\n\n[![Catalyst logo](https://raw.githubusercontent.com/catalyst-team/catalyst-pics/master/pics/catalyst_logo.png)](https://github.com/catalyst-team/catalyst)\n\n**Accelerated RL**\n\n[![Build Status](http://66.248.205.49:8111/app/rest/builds/buildType:id:Catalyst_Deploy/statusIcon.svg)](http://66.248.205.49:8111/project.html?projectId=Catalyst\u0026tab=projectOverview\u0026guest=1)\n[![CodeFactor](https://www.codefactor.io/repository/github/catalyst-team/catalyst/badge)](https://www.codefactor.io/repository/github/catalyst-team/catalyst)\n[![Pipi version](https://img.shields.io/pypi/v/catalyst.svg)](https://pypi.org/project/catalyst/)\n[![Docs](https://img.shields.io/badge/dynamic/json.svg?label=docs\u0026url=https%3A%2F%2Fpypi.org%2Fpypi%2Fcatalyst%2Fjson\u0026query=%24.info.version\u0026colorB=brightgreen\u0026prefix=v)](https://catalyst-team.github.io/catalyst/index.html)\n[![PyPI Status](https://pepy.tech/badge/catalyst)](https://pepy.tech/project/catalyst)\n\n[![Twitter](https://img.shields.io/badge/news-twitter-499feb)](https://twitter.com/CatalystTeam)\n[![Telegram](https://img.shields.io/badge/channel-telegram-blue)](https://t.me/catalyst_team)\n[![Slack](https://img.shields.io/badge/Catalyst-slack-success)](https://join.slack.com/t/catalyst-team-devs/shared_invite/zt-d9miirnn-z86oKDzFMKlMG4fgFdZafw)\n[![Github contributors](https://img.shields.io/github/contributors/catalyst-team/catalyst.svg?logo=github\u0026logoColor=white)](https://github.com/catalyst-team/catalyst/graphs/contributors)\n\n\u003c/div\u003e\n\nPyTorch framework for RL research.\nIt was developed with a focus on reproducibility,\nfast experimentation and code/ideas reusing.\nBeing able to research/develop something new,\nrather than write another regular train loop. \u003cbr/\u003e\nBreak the cycle - use the Catalyst!\n\nProject [manifest](https://github.com/catalyst-team/catalyst/blob/master/MANIFEST.md). Part of [PyTorch Ecosystem](https://pytorch.org/ecosystem/). Part of [Catalyst Ecosystem](https://docs.google.com/presentation/d/1D-yhVOg6OXzjo9K_-IS5vSHLPIUxp1PEkFGnpRcNCNU/edit?usp=sharing):\n- [Alchemy](https://github.com/catalyst-team/alchemy) - Experiments logging \u0026 visualization\n- [Catalyst](https://github.com/catalyst-team/catalyst) - Accelerated Deep Learning Research and Development\n- [Reaction](https://github.com/catalyst-team/reaction) - Convenient Deep Learning models serving\n\n[Catalyst at AI Landscape](https://landscape.lfai.foundation/selected=catalyst).\n\n---\n\n## Installation\n\nCommon installation:\n```bash\npip install -U catalyst-rl\n```\n\nCatalyst.RL is compatible with: Python 3.6+. PyTorch 1.0.0+.\n\n\n## Getting started\n\nFor Catalyst.RL introduction, please follow [OpenAI Gym example](https://github.com/catalyst-team/catalyst-rl/tree/master/examples/rl_gym).\n\n\n#### Docs and examples\n- [Demo with minimal examples](https://github.com/catalyst-team/catalyst/tree/master/examples/notebooks/demo.ipynb) for CV, NLP, RecSys and GANs [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/catalyst-team/catalyst/blob/master/examples/notebooks/demo.ipynb)\n- Detailed [classification tutorial](https://github.com/catalyst-team/catalyst/tree/master/examples/notebooks/classification-tutorial.ipynb) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/catalyst-team/catalyst/blob/master/examples/notebooks/classification-tutorial.ipynb)\n- Advanced [segmentation tutorial](https://github.com/catalyst-team/catalyst/tree/master/examples/notebooks/segmentation-tutorial.ipynb) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/catalyst-team/catalyst/blob/master/examples/notebooks/segmentation-tutorial.ipynb)\n- Comprehensive [classification pipeline](https://github.com/catalyst-team/classification)\n- Binary and semantic [segmentation pipeline](https://github.com/catalyst-team/segmentation)\n\nAPI documentation and an overview of the library can be found here\n[![Docs](https://img.shields.io/badge/dynamic/json.svg?label=docs\u0026url=https%3A%2F%2Fpypi.org%2Fpypi%2Fcatalyst%2Fjson\u0026query=%24.info.version\u0026colorB=brightgreen\u0026prefix=v)](https://catalyst-team.github.io/catalyst/index.html). \u003cbr/\u003e\nIn the **[examples folder](examples)**\nof the repository, you can find advanced tutorials and Catalyst best practices.\n\n##### Infos\nTo learn more about Catalyst internals and to be aware of the most important features, you can read **[Catalyst-info](https://github.com/catalyst-team/catalyst-info)** – our blog where we regularly write facts about the framework.\n\nWe also supervise **[Awesome Catalyst list](https://github.com/catalyst-team/awesome-catalyst-list)** – Catalyst-powered projects, tutorials and talks. \u003cbr/\u003e\nFeel free to make a PR with your project to the list. And don't forget to check out current list, there are many interesting projects.\n\n##### Releases\nWe deploy a major release once a month with a name like `YY.MM`. \u003cbr/\u003e\nAnd micro-releases with framework improvements during a month in the format `YY.MM.#`.\n\nYou can view the changelog on the **[GitHub Releases](https://github.com/catalyst-team/catalyst/releases)** page. \u003cbr/\u003e\nCurrent version: [![Pipi version](https://img.shields.io/pypi/v/catalyst.svg)](https://pypi.org/project/catalyst/)\n\n\n## Overview\n\nCatalyst.RL helps you write compact\nbut full-featured RL pipelines in a few lines of code.\nYou get a training loop with metrics, early-stopping, model checkpointing\nand other features without the boilerplate.\n\n#### Features\n\n- Universal train/inference loop.\n- Configuration files for model/data hyperparameters.\n- Reproducibility – all source code and environment variables will be saved.\n- Callbacks – reusable train/inference pipeline parts.\n- Training stages support.\n- Easy customization.\n- PyTorch best practices (SWA, AdamW, Ranger optimizer, OneCycle, FP16 and more).\n\n#### Structure\n\n- **RL** – scalable Reinforcement Learning,\n   all popular model-free algorithms implementations and their improvements\n   with distributed training support.\n- **contrib** - additional modules contributed by Catalyst users.\n- **utils** - different useful utils for Deep Learning research.\n\n## Contribution guide\n\nWe appreciate all contributions.\nIf you are planning to contribute back bug-fixes,\nplease do so without any further discussion.\nIf you plan to contribute new features, utility functions or extensions,\nplease first open an issue and discuss the feature with us.\n\n- Please see the [contribution guide](CONTRIBUTING.md) for more information.\n- By participating in this project, you agree to abide by its [Code of Conduct](CODE_OF_CONDUCT.md).\n\n## License\n\nThis project is licensed under the Apache License, Version 2.0 see the [LICENSE](LICENSE) file for details\n[![License](https://img.shields.io/github/license/catalyst-team/catalyst.svg)](LICENSE)\n\n## Citation\n\nPlease use this bibtex if you want to cite this repository in your publications:\n\n    @misc{catalyst,\n        author = {Kolesnikov, Sergey},\n        title = {Accelerated RL.},\n        year = {2018},\n        publisher = {GitHub},\n        journal = {GitHub repository},\n        howpublished = {\\url{https://github.com/catalyst-team/catalyst-rl}},\n    }\n","funding_links":[],"categories":["Reinforcement Learning"],"sub_categories":["Others"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcatalyst-team%2Fcatalyst-rl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcatalyst-team%2Fcatalyst-rl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcatalyst-team%2Fcatalyst-rl/lists"}