https://github.com/isl-org/vision-for-action
Code to accompany "Does computer vision matter for action?"
https://github.com/isl-org/vision-for-action
Last synced: 5 months ago
JSON representation
Code to accompany "Does computer vision matter for action?"
- Host: GitHub
- URL: https://github.com/isl-org/vision-for-action
- Owner: isl-org
- Created: 2019-05-09T22:42:47.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2019-06-14T17:23:30.000Z (over 6 years ago)
- Last Synced: 2024-05-21T13:58:22.156Z (over 1 year ago)
- Language: Python
- Homepage:
- Size: 320 KB
- Stars: 41
- Watchers: 12
- Forks: 6
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# DISCONTINUATION OF PROJECT #
This project will no longer be maintained by Intel.
Intel has ceased development and contributions including, but not limited to, maintenance, bug fixes, new releases, or updates, to this project.
Intel no longer accepts patches to this project.
If you have an ongoing need to use this project, are interested in independently developing it, or would like to maintain patches for the open source software community, please create your own fork of this project.
## Does computer vision matter for action?
[Brady Zhou](http://www.bradyzhou.com), [Philipp Krähenbühl](http://www.philkr.net), and [Vladlen Koltun](http://www.vladlen.info)
Science Robotics, 4(30), 2019
[Paper](https://robotics.sciencemag.org/content/4/30/eaaw6661?ijkey=z3zMGrf4SfjN6&keytype=ref&siteid=robotics)
[Project](http://www.bradyzhou.com/visionforaction/)
Code to accompany the paper.
## Installation
```
git clone --recursive https://github.com/intel-isl/vision-for-action.git
```
#### ViZDoom
We require building from source using the included submodule,
which includes hacks for getting labels for the walls and floors.
```bash
cd ViZDoom
cmake -DCMAKE_BUILD_TYPE=Release -DBUILD_PYTHON3=ON
make
```
Link ViZDoom and helpers to `PYTHONPATH`.
```bash
export PYTHONPATH=$PYTHONPATH:$PWD/ViZDoom/bin/python3.6/pip_package
export PYTHONPATH=$PYTHONPATH:$PWD
```
#### GTA V
This is supported on Windows machines only, and will take a little bit of effort.
You will need to install the following -
- a modified [GameHook](https://github.com/bradyz/gamehook)
- a modified [GameHook GTA V Plugin](https://github.com/bradyz/gamehook_gtav)
- a modified [PyHookV](https://github.com/bradyz/pyhookv)
After successfully building all of these projects, you should have
```
dxgi.dll (renamed from gamehook.dll)
python.hk
server.hk
gta5.hk
pyhookv.pyd
```
Take all of these files and put them in the directory where `GTAV.exe` lives.
Additionally, move the following files from the `gta_v` directory to the same directory.
```
agents_privileged.py
constants.py
controller.py
controls.py
message_packer.py
pyhookv_utils.py
presets.py
scenarios.py
```
## Citation
```
@article{Zhou2019DoesCV,
title={Does computer vision matter for action?},
author={Brady Zhou and Philipp Kr{\"a}henb{\"u}hl and Vladlen Koltun},
journal={Science Robotics},
volume={4},
number={30},
year={2019}
}
```