{"id":24745212,"url":"https://github.com/shandilya1998/neurorobotics","last_synced_at":"2026-04-12T05:36:55.069Z","repository":{"id":52525578,"uuid":"407651885","full_name":"shandilya1998/neurorobotics","owner":"shandilya1998","description":"Python tools for robotics, deep reinforcement learning and neuroscience research.","archived":false,"fork":false,"pushed_at":"2023-04-10T03:19:53.000Z","size":440684,"stargazers_count":0,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-22T23:25:29.223Z","etag":null,"topics":["computational-neuroscience","mujoco","mujoco-py","numpy","openai-gym","pytorch","reinforcement-learning","robotics"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shandilya1998.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-09-17T19:04:46.000Z","updated_at":"2022-06-24T19:05:36.000Z","dependencies_parsed_at":"2025-03-22T23:34:59.591Z","dependency_job_id":null,"html_url":"https://github.com/shandilya1998/neurorobotics","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/shandilya1998/neurorobotics","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shandilya1998%2Fneurorobotics","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shandilya1998%2Fneurorobotics/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shandilya1998%2Fneurorobotics/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shandilya1998%2Fneurorobotics/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shandilya1998","download_url":"https://codeload.github.com/shandilya1998/neurorobotics/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shandilya1998%2Fneurorobotics/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31705574,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-12T05:11:36.334Z","status":"ssl_error","status_checked_at":"2026-04-12T05:11:27.332Z","response_time":58,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["computational-neuroscience","mujoco","mujoco-py","numpy","openai-gym","pytorch","reinforcement-learning","robotics"],"created_at":"2025-01-28T02:45:35.015Z","updated_at":"2026-04-12T05:36:55.051Z","avatar_url":"https://github.com/shandilya1998.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# NavigationController\n\n## Spawn Test Environment\n```\nfrom simulations.maze_env import MazeEnv\nfrom simulations.point import PointEnv\nfrom simulations.maze_task import CustomGoalReward4Rooms\nenv = MazeEnv(PointEnv, CustomRewardGoal4Rooms)\n```\n\n## Experiment Checklist\n\n- Check and update `def step(**kwargs)` and `def _set_action_space(**kwargs)` in [simulations/point.py](simulations/point.py)\n- Check and update `def _get_obs(**kwargs)` and `def _set_observation_space(**kwargs)` in [simulations/maze_env.py](simulations/maze_env.py) and [simulations/point.py](simulations/point.py) \n- Update Reward and Info Computation Pipeline\n- Check and update `class Actor` and `class Critic` in [utils/rtd3_utils.py](utils/rtd3_utils.py)\n- Check and update `class Autoencoder`, `class VisualCortexV4`, `class EncoderBody` and `class FeatureExtractionBackbone` in [bg/models.py](bg/models.py)\n- Check and update `def update_policy(**kwargs)` and `def _sample_action(**kwargs)` in [utils/rtd3_utils.py](utils/rtd3_utils.py)\n- Check and update `def predict(**kwargs)` in [utils/rtd3_utils.py](utils/rtd3_utils.py)\n- Ensure `squash_output` is False in `class Actor` if using inverted gradients method\n- Check and update `seed`, `batch_size`, `learning_starts`, `imitation_steps` and `debug` in `params` from [constant.py](constants.py)\n- Check and update other hyperparameters for tuning\n- Set `LOGDIR`, `ENV_TYPE`, `TIMESTEPS`, `MAX_EPISODE_SIZE`, `HISTORY_STEPS` and `TASK_VERSION` in [train.sh](train.sh)\n- Check and update `net_arch` and `n_critics` in [learning/explore.py](learning/explore.py)\n- Run `sh train.sh` in terminal for debugging. Run `nohup sh train.sh \u003e\u003e assets/out/models/train.log \u0026` in terminal for GPU execution.\n- Commit and Push to Github. Update local `experiments_log`\n\n## Installation on docker\n\n- Run `docker build -t neuroengineering-tools ./docker/cpu/` in the root folder of the repository.\n- Run `docker run -dit --name sample neuroengineering-tools` to spawn  a new container.\n- Run desired command with the tools in the container.\n- Run `docker stop neuroengineering-tools` to stop running container.\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshandilya1998%2Fneurorobotics","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshandilya1998%2Fneurorobotics","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshandilya1998%2Fneurorobotics/lists"}