{"id":16658451,"url":"https://github.com/sritchie/scala-rl","last_synced_at":"2025-03-21T16:32:23.068Z","repository":{"id":35185784,"uuid":"200713738","full_name":"sritchie/scala-rl","owner":"sritchie","description":"Functional Reinforcement Learning in Scala.","archived":false,"fork":false,"pushed_at":"2024-08-19T20:49:44.000Z","size":4235,"stargazers_count":26,"open_issues_count":26,"forks_count":5,"subscribers_count":1,"default_branch":"develop","last_synced_at":"2025-03-18T03:12:59.617Z","etag":null,"topics":["deep-reinforcement-learning","functional-programming","reinforcement-learning","reinforcement-learning-tutorials"],"latest_commit_sha":null,"homepage":"https://www.scalarl.com","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sritchie.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":"sritchie","patreon":"sritchie"}},"created_at":"2019-08-05T19:07:41.000Z","updated_at":"2024-04-02T17:40:37.000Z","dependencies_parsed_at":"2024-10-28T11:27:11.528Z","dependency_job_id":"bd3d4523-cbfe-4840-b93b-bfc521196ecd","html_url":"https://github.com/sritchie/scala-rl","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sritchie%2Fscala-rl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sritchie%2Fscala-rl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sritchie%2Fscala-rl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sritchie%2Fscala-rl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sritchie","download_url":"https://codeload.github.com/sritchie/scala-rl/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244829578,"owners_count":20517331,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-reinforcement-learning","functional-programming","reinforcement-learning","reinforcement-learning-tutorials"],"created_at":"2024-10-12T10:05:38.419Z","updated_at":"2025-03-21T16:32:22.571Z","avatar_url":"https://github.com/sritchie.png","language":"Scala","funding_links":["https://github.com/sponsors/sritchie","https://patreon.com/sritchie","https://www.patreon.com/sritchie"],"categories":[],"sub_categories":[],"readme":"# Functional RL in Scala\n\n[![Build status](https://img.shields.io/travis/sritchie/scala-rl/develop.svg?maxAge=3600)](http://travis-ci.com/sritchie/scala-rl)\n[![Codecov branch](https://img.shields.io/codecov/c/github/sritchie/scala-rl/develop.svg?maxAge=3600)](https://codecov.io/github/sritchie/scala-rl)\n[![Latest version](https://index.scala-lang.org/sritchie/scala-rl/scala-rl-core/latest.svg?color=orange)](https://index.scala-lang.org/sritchie/scala-rl/scala-rl-core)\n[![Gitter](https://badges.gitter.im/ScalaRL/community.svg)](https://gitter.im/ScalaRL/community?utm_source=badge\u0026utm_medium=badge\u0026utm_campaign=pr-badge)\n[![Patreon](https://img.shields.io/badge/patreon-donate-blue.svg)](https://www.patreon.com/sritchie)\n\n### Overview\n\nReinforcement Learning in Scala, the functional way.\n\nI definitely don't need to go fully overboard... but the gold standard is to reimplement a bunch of this stuff:\n\nhttps://github.com/ShangtongZhang/reinforcement-learning-an-introduction\n\nin Scala.\n\n## Notes\n\nCan we write the update steps in some interesting way? Like, you have a function that you pass an action to, and eventually it returns some reward? I think so!\n\n## Blog Series\n\nThis code supports the blog series on functional reinforcement learning.\n\n## Get Involved\n\nWant to contribute examples or use this stuff?\n\n## Inspiration\n\n- the book, Reinforcement Learning.\n- https://github.com/ShangtongZhang/reinforcement-learning-an-introduction\n\n## To File\n\n- I'm using Rainier's version, but this is a nice article about the\nprobability Monad:\nhttps://www.chrisstucchio.com/blog/2016/probability_the_monad.html\n- We use ScalaFMT https://scalameta.org/scalafmt/docs/installation.html\n- also, wartremover http://www.wartremover.org\n\n\n## License\n\nCopyright 2019 Sam Ritchie.\n\nLicensed under the [Apache License, Version 2.0](http://www.apache.org/licenses/LICENSE-2.0).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsritchie%2Fscala-rl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsritchie%2Fscala-rl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsritchie%2Fscala-rl/lists"}