{"id":19529281,"url":"https://github.com/isl-org/vision-for-action","last_synced_at":"2025-08-24T04:20:56.309Z","repository":{"id":82225052,"uuid":"185881488","full_name":"isl-org/vision-for-action","owner":"isl-org","description":"Code to accompany \"Does computer vision matter for action?\"","archived":false,"fork":false,"pushed_at":"2019-06-14T17:23:30.000Z","size":328,"stargazers_count":41,"open_issues_count":2,"forks_count":6,"subscribers_count":12,"default_branch":"master","last_synced_at":"2024-05-21T13:58:22.156Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/isl-org.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-05-09T22:42:47.000Z","updated_at":"2024-07-25T04:50:04.416Z","dependencies_parsed_at":null,"dependency_job_id":"3f260d72-0e35-430b-abdd-11513b238ff8","html_url":"https://github.com/isl-org/vision-for-action","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/isl-org%2Fvision-for-action","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/isl-org%2Fvision-for-action/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/isl-org%2Fvision-for-action/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/isl-org%2Fvision-for-action/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/isl-org","download_url":"https://codeload.github.com/isl-org/vision-for-action/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":224033556,"owners_count":17244618,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-11T01:23:21.986Z","updated_at":"2024-11-11T01:23:23.738Z","avatar_url":"https://github.com/isl-org.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# DISCONTINUATION OF PROJECT #  \nThis project will no longer be maintained by Intel.  \nIntel has ceased development and contributions including, but not limited to, maintenance, bug fixes, new releases, or updates, to this project.  \nIntel no longer accepts patches to this project.  \n If you have an ongoing need to use this project, are interested in independently developing it, or would like to maintain patches for the open source software community, please create your own fork of this project.  \n  \n## Does computer vision matter for action?\r\n\r\n[Brady Zhou](http://www.bradyzhou.com), [Philipp Krähenbühl](http://www.philkr.net), and [Vladlen Koltun](http://www.vladlen.info)  \r\nScience Robotics, 4(30), 2019  \r\n[Paper](https://robotics.sciencemag.org/content/4/30/eaaw6661?ijkey=z3zMGrf4SfjN6\u0026keytype=ref\u0026siteid=robotics)  \r\n[Project](http://www.bradyzhou.com/visionforaction/)\r\n\r\nCode to accompany the paper.  \r\n\r\n\u003cimg src=\"logo.jpg\" style=\"width: 300px;\"/\u003e\r\n\r\n## Installation\r\n\r\n```\r\ngit clone --recursive https://github.com/intel-isl/vision-for-action.git\r\n```\r\n\r\n#### ViZDoom\r\n\r\nWe require building from source using the included submodule,  \r\nwhich includes hacks for getting labels for the walls and floors.\r\n\r\n```bash\r\ncd ViZDoom\r\ncmake -DCMAKE_BUILD_TYPE=Release -DBUILD_PYTHON3=ON\r\nmake\r\n```\r\n\r\nLink ViZDoom and helpers to `PYTHONPATH`.\r\n\r\n```bash\r\nexport PYTHONPATH=$PYTHONPATH:$PWD/ViZDoom/bin/python3.6/pip_package\r\nexport PYTHONPATH=$PYTHONPATH:$PWD\r\n```\r\n\r\n#### GTA V\r\n\r\nThis is supported on Windows machines only, and will take a little bit of effort.\r\n\r\nYou will need to install the following -\r\n\r\n- a modified [GameHook](https://github.com/bradyz/gamehook)\r\n- a modified [GameHook GTA V Plugin](https://github.com/bradyz/gamehook_gtav)\r\n- a modified [PyHookV](https://github.com/bradyz/pyhookv)\r\n\r\nAfter successfully building all of these projects, you should have\r\n\r\n```\r\ndxgi.dll (renamed from gamehook.dll)\r\npython.hk\r\nserver.hk\r\ngta5.hk\r\npyhookv.pyd\r\n```\r\n\r\nTake all of these files and put them in the directory where `GTAV.exe` lives.  \r\nAdditionally, move the following files from the `gta_v` directory to the same directory.\r\n\r\n```\r\nagents_privileged.py\r\nconstants.py\r\ncontroller.py\r\ncontrols.py\r\nmessage_packer.py\r\npyhookv_utils.py\r\npresets.py\r\nscenarios.py\r\n```\r\n\r\n## Citation\r\n\r\n```\r\n@article{Zhou2019DoesCV,\r\n  title={Does computer vision matter for action?},\r\n  author={Brady Zhou and Philipp Kr{\\\"a}henb{\\\"u}hl and Vladlen Koltun},\r\n  journal={Science Robotics},\r\n  volume={4},\r\n  number={30},\r\n  year={2019}\r\n}\r\n```\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fisl-org%2Fvision-for-action","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fisl-org%2Fvision-for-action","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fisl-org%2Fvision-for-action/lists"}