{"id":13568505,"url":"https://github.com/Scitator/learning-to-move-starter-kit","last_synced_at":"2025-04-04T04:31:17.399Z","repository":{"id":133294382,"uuid":"201034597","full_name":"Scitator/learning-to-move-starter-kit","owner":"Scitator","description":null,"archived":false,"fork":false,"pushed_at":"2019-08-07T11:49:18.000Z","size":167,"stargazers_count":9,"open_issues_count":1,"forks_count":2,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-31T11:16:26.322Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Scitator.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2019-08-07T11:14:27.000Z","updated_at":"2023-08-15T07:47:58.000Z","dependencies_parsed_at":null,"dependency_job_id":"300dfd35-bbdb-431c-877b-8c4b53dcda08","html_url":"https://github.com/Scitator/learning-to-move-starter-kit","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Scitator%2Flearning-to-move-starter-kit","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Scitator%2Flearning-to-move-starter-kit/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Scitator%2Flearning-to-move-starter-kit/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Scitator%2Flearning-to-move-starter-kit/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Scitator","download_url":"https://codeload.github.com/Scitator/learning-to-move-starter-kit/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247123072,"owners_count":20887259,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-01T14:00:26.909Z","updated_at":"2025-04-04T04:31:12.381Z","avatar_url":"https://github.com/Scitator.png","language":"Python","funding_links":[],"categories":["Repositories"],"sub_categories":[],"readme":"# [NeurIPS 2019: Learn to Move - Walk Around](https://www.aicrowd.com/challenges/neurips-2019-learn-to-move-walk-around) \u003cbr/\u003e [Catalyst](https://github.com/catalyst-team/catalyst) starter kit\n\n## Environment setup.\n(Taken from the official [repo](https://github.com/stanfordnmbl/osim-rl)).\n\n**Anaconda** is required to run our simulations. Anaconda will create a virtual environment with all the necessary libraries, to avoid conflicts with libraries in your operating system. You can get anaconda from here https://docs.anaconda.com/anaconda/install/. In the following instructions we assume that Anaconda is successfully installed.\n\nFor the challenge we prepared [OpenSim](http://opensim.stanford.edu/) binaries as a conda environment to make the installation straightforward\n\nWe support Windows, Linux, and Mac OSX (all in 64-bit). To install our simulator, you first need to create a conda environment with the OpenSim package.\n\nOn **Windows**, open a command prompt and type:\n```bash\nconda create -n opensim-rl -c kidzik opensim python=3.6.1\nactivate opensim-rl\n```\n\nOn **Linux/OSX**, run:\n```bash\nconda create -n opensim-rl -c kidzik opensim python=3.6.1\nsource activate opensim-rl\n```\n\nThese commands will create a virtual environment on your computer with the necessary simulation libraries installed. Next, you need to install our python reinforcement learning environment. Type (on all platforms):\n```bash\nconda install -c conda-forge lapack git\npip install osim-rl\n```\n\n\n### Basic usage\n\nTo execute 200 iterations of the simulation enter the `python` interpreter and run the following:\n```python\nfrom osim.env import L2M2019Env\n\nenv = L2M2019Env(visualize=True)\nobservation = env.reset()\nfor i in range(200):\n    observation, reward, done, info = env.step(env.action_space.sample())\n```\n\n\n## Catalyst.RL\n\nTo train agents on the L2M environment, we can run Catalyst.RL as usual.\n```bash\nexport LOGDIR=...\nbash bin/prepare_configs.sh\n\n# start db node\nmongod --config ./configs/_mongod.conf --port 12000\n\n# start trainer node\nexport GPUS=\"\"  # like GPUS=\"0\" or GPUS=\"0,1\" for multi-gpu training\nCUDA_VISIBLE_DEVICES=\"$GPUS\" catalyst-rl run-trainer --config ./configs/_exp_common.yml ./configs/_dpg_common.yml ./configs/ddpg.yml\n\n# start sampler node\nCUDA_VISIBLE_DEVICES=\"\" catalyst-rl run-samplers --config ./configs/_exp_common.yml ./configs/_dpg_common.yml ./configs/ddpg.yml\n\n# view tensorboard logs\nCUDA_VISIBLE_DEVICE=\"\" tensorboard --logdir=./logs\n```\n\n\nFor more information about Catalyst.RL you can check [official repo](https://github.com/catalyst-team/catalyst), [documentaiton](https://catalyst-team.github.io/catalyst/) and [examples](https://github.com/catalyst-team/catalyst/tree/master/examples/rl_gym).\n\n## Results\n\nAfter a while you can see something like\n![alt text](./pics/result.png)\nThis shows us mean validation reward based on 64 episodes.\n\n\nI hope this agent is only the beginning of you RL path and you can do much better.\n\nEnjoy the competition!","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FScitator%2Flearning-to-move-starter-kit","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FScitator%2Flearning-to-move-starter-kit","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FScitator%2Flearning-to-move-starter-kit/lists"}