Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/uzh-rpg/rpg_dvs_ros
ROS packages for DVS
https://github.com/uzh-rpg/rpg_dvs_ros
Last synced: about 5 hours ago
JSON representation
ROS packages for DVS
- Host: GitHub
- URL: https://github.com/uzh-rpg/rpg_dvs_ros
- Owner: uzh-rpg
- License: mit
- Created: 2014-02-13T13:15:35.000Z (over 10 years ago)
- Default Branch: master
- Last Pushed: 2023-10-02T19:32:06.000Z (about 1 year ago)
- Last Synced: 2024-05-07T18:19:30.886Z (6 months ago)
- Language: C++
- Size: 508 KB
- Stars: 280
- Watchers: 35
- Forks: 146
- Open Issues: 35
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
rpg_dvs_ros
===========
# Disclaimer and License
The RPG ROS DVS package is supported under ROS Kinetic (Ubuntu 16.04), ROS Melodic (Ubuntu 18.04) and ROS Noetic (Ubuntu 20.04).
This is research code, expect that it changes often and any fitness for a particular purpose is disclaimed.
The source code is released under the **MIT License**.
# Package Overview
The ROS DVS package provides C++ drivers for the [Dynamic Vision Sensors (DVS/DAVIS)](https://inivation.com/dvp/).
Even if you do not have a DAVS or DAVIS device, you can still [use this driver to read pre-recorded event data files (see the example below)](#ExampleEventCameraDataset).
The package also provides a calibration tool for both intrinsic and stereo calibration.
To find out more about event cameras, visit the website of the [Institute of Neuroinformatics](http://siliconretina.ini.uzh.ch/wiki/index.php).
The package is based on [libcaer](https://gitlab.com/inivation/libcaer/).
Authors: Elias Mueggler, Basil Huber, Luca Longinotti, Tobi Delbruck
## Publications
If you use this work in an academic context, please cite the following publications:
* E. Mueggler, B. Huber, D. Scaramuzza: **Event-based, 6-DOF Pose Tracking for High-Speed Maneuvers**. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Chicago, 2014. ([PDF](http://rpg.ifi.uzh.ch/docs/IROS14_Mueggler.pdf))
* P. Lichtsteiner, C. Posch, T. Delbruck: **A 128×128 120dB 15us Latency Asynchronous Temporal Contrast Vision Sensor**. IEEE Journal of Solid State Circuits, Feb. 2008, 43(2), pp. 566-576. ([PDF](https://www.ini.uzh.ch/~tobi/wiki/lib/exe/fetch.php?media=lichtsteiner_dvs_jssc08.pdf))
* C. Brandli, R. Berner, M. Yang, S. C. Liu and T. Delbruck: **A 240 × 180 130 dB 3 us Latency Global Shutter Spatiotemporal Vision Sensor**. IEEE Journal of Solid-State Circuits, Oct. 2014, 49(10), pp. 2333-2341. ([Link](ieeexplore.ieee.org/document/6889103))
# Driver Installation
NOTE: substitute any mention of kinetic in the following instruction with the name of your current ROS distribution.
1. Install ROS dependencies:
* `$ sudo apt-get install ros-kinetic-camera-info-manager`
* `$ sudo apt-get install ros-kinetic-image-view`
2. Install libcaer (add required repositories as per [iniVation documentation](https://inivation.gitlab.io/dv/dv-docs/docs/getting-started.html#ubuntu-linux) first):
* `$ sudo apt-get install libcaer-dev`
3. Install catkin tools:
* `$ sudo apt-get install python-catkin-tools`
4. Create a catkin workspace (if you have not done it yet):
* `$ cd`
* `$ mkdir -p catkin_ws/src`
* `$ cd catkin_ws`
* `$ catkin config --init --mkdirs --extend /opt/ros/kinetic --merge-devel --cmake-args -DCMAKE_BUILD_TYPE=Release`
5. Clone the `catkin_simple` package (https://github.com/catkin/catkin_simple), which will be used to build the DVS/DAVIS driver packages:
* `$ cd ~/catkin_ws/src`
* `$ git clone https://github.com/catkin/catkin_simple.git`
6. Clone this repository:
* `$ cd ~/catkin_ws/src`
* `$ git clone https://github.com/uzh-rpg/rpg_dvs_ros.git`
7. Build the packages:
* `$ catkin build dvs_ros_driver` (if you are using the DVS128)
* `$ catkin build davis_ros_driver` (if you are using the DAVIS)
* `$ catkin build dvxplorer_ros_driver` (if you are using the DVXplorer)
8. You can test the installation by running a provided launch file. It starts the driver (DVS or DAVIS) and the renderer (an image viewer).
1. First, build the renderer:
* `$ catkin build dvs_renderer`
2. Set up the environment:
* `$ source ~/catkin_ws/devel/setup.bash` or if you use the zsh shell instead `$ source ~/catkin_ws/devel/setup.zsh`
3. Then, launch the example:
* `$ roslaunch dvs_renderer dvs_mono.launch` (if you are using the DVS128)
* `$ roslaunch dvs_renderer davis_mono.launch` (if you are using the DAVIS)
* `$ roslaunch dvs_renderer dvxplorer_mono.launch` (if you are using the DVXplorer)
You should get an image like this (in case of the DAVIS):
9. **If you do not have a DAVIS, you can still use this driver to read recorded files**, such as those of [The Event Camera Dataset and Simulator](http://rpg.ifi.uzh.ch/davis_data.html).
**Example**:
1. Download a squence of the dataset, such as [slider_depth.bag](http://rpg.ifi.uzh.ch/datasets/davis/slider_depth.bag)
2. Open a terminal and launch the roscore:
* `$ roscore`
3. In another terminal, play the bag:
* `$ rosbag play -l path-to-file/slider_depth.bag`
4. In another terminal, launch the DVS/DAVIS renderer:
* `$ roslaunch dvs_renderer renderer_mono.launch`
You should see a movie with images like this:
10. Optional: in the case of a **live stream** from the DAVIS (i.e., not a recorded file) you may adjust the DVS/DAVIS parameters to your needs using the dynamic reconfigure GUI. Run
* `$ rosrun rqt_reconfigure rqt_reconfigure`
and a window will appear. Select the `davis_ros_driver` (on the left panel) and you should get the following GUI that allows you to modify the parameters of the sensor.
A guide on how to modify the parameters in the bottom half of the GUI (biases) can be found here: https://inivation.github.io/inivation-docs/Advanced%20configurations/User_guide_-_Biasing.html
# Calibration
For intrinsic or stereo calibration of the DVS and DAVIS, please have a look at the following [document](dvs_calibration/README.md).
# Troubleshooting
## New dvs_msgs format
If you recorded rosbags with a previous version of this package, they must be migrated.
The format for the timestamps changed from uint64 to rostime.
To convert an "old" bag file, use:
`$ rosbag fix old.bag new.bag`.
## Compiling error
On Ubuntu 14.04 with GCC 4.8, you will receive an error about missing file (`stdatomic.h`).
This is a [problem](https://gcc.gnu.org/bugzilla/show_bug.cgi?id=58016) related to GCC 4.8 and can be resolved by [updating to version 4.9](http://askubuntu.com/a/581497/218846):
sudo add-apt-repository ppa:ubuntu-toolchain-r/test
sudo apt-get update
sudo apt-get install gcc-4.9 g++-4.9
sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-4.9 60 --slave /usr/bin/g++ g++ /usr/bin/g++-4.9