{"id":20340828,"url":"https://github.com/taylor-eos/actor-critic-dot","last_synced_at":"2025-03-04T14:46:56.413Z","repository":{"id":260175640,"uuid":"874870870","full_name":"Taylor-eOS/actor-critic-dot","owner":"Taylor-eOS","description":"A stupid minigame in which a neural net learns to avoid poison walls","archived":false,"fork":false,"pushed_at":"2024-10-30T17:51:43.000Z","size":17,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-14T18:42:02.058Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Taylor-eOS.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-18T16:00:44.000Z","updated_at":"2024-11-10T14:30:40.000Z","dependencies_parsed_at":null,"dependency_job_id":"12d67d09-f008-4172-90ae-fb828ead669a","html_url":"https://github.com/Taylor-eOS/actor-critic-dot","commit_stats":null,"previous_names":["taylor-eos/actor-critic-dot"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Taylor-eOS%2Factor-critic-dot","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Taylor-eOS%2Factor-critic-dot/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Taylor-eOS%2Factor-critic-dot/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Taylor-eOS%2Factor-critic-dot/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Taylor-eOS","download_url":"https://codeload.github.com/Taylor-eOS/actor-critic-dot/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241867696,"owners_count":20033816,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-14T21:23:56.723Z","updated_at":"2025-03-04T14:46:56.393Z","avatar_url":"https://github.com/Taylor-eOS.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"The `actor-critic-dot` project is a simple experimental setup for testing neural network behavior.\nA moving dot repeatedly decides towards which of the four sides of the field to move from the center, learning over time to avoid red walls that are poisonous and prefer green walls that are rewarding.\nIt does this without any hardcoded knowledge of the environment or the rules of the game.\nThe dot makes decisions through an actor-critic reinforcement learning model.\nUsers can alter wall statuses by clicking on them in the game window, which will toggle them between safe (green) and poisonous (red).\nThis project was meant as a straightforward test for exploring neural network adaptation and reinforcement learning principles.\nProgramming this was incredibly finicky, as neural nets are fickle and impossible to get to do what you want. So this project did not progress very far.\n\nHow to use:\n- Download the `py` file\n- Create a venv environment\n- Install `requirements`\n- Run `actor_critic.py`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftaylor-eos%2Factor-critic-dot","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftaylor-eos%2Factor-critic-dot","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftaylor-eos%2Factor-critic-dot/lists"}