https://github.com/uzh-rpg/rpg_esim

ESIM: an Open Event Camera Simulator
https://github.com/uzh-rpg/rpg_esim

Last synced: about 1 month ago
JSON representation

ESIM: an Open Event Camera Simulator

• Host: GitHub
• URL: https://github.com/uzh-rpg/rpg_esim
• Owner: uzh-rpg
• License: mit
• Created: 2018-10-29T16:25:41.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2023-12-25T19:52:46.000Z (12 months ago)
• Last Synced: 2024-05-07T18:19:31.137Z (7 months ago)
• Language: C
• Size: 50.4 MB
• Stars: 555
• Watchers: 20
• Forks: 116
• Open Issues: 78
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-robotic-tooling - ESIM - an Open Event Camera Simulator (Simulation / Calibration and Transformation)

README

        
# ESIM: an Open Event Camera Simulator

[![ESIM: an Open Event Camera Simulator](http://rpg.ifi.uzh.ch/esim/img/youtube_preview.png)](https://youtu.be/ytKOIX_2clo)

This is the code for the 2018 CoRL paper **ESIM: an Open Event Camera Simulator** by [Henri Rebecq](http://henri.rebecq.fr), [Daniel Gehrig](https://danielgehrig18.github.io/) and [Davide Scaramuzza](http://rpg.ifi.uzh.ch/people_scaramuzza.html):

```bibtex

@Article{Rebecq18corl,

  author        = {Henri Rebecq and Daniel Gehrig and Davide Scaramuzza},

  title         = {{ESIM}: an Open Event Camera Simulator},

  journal       = {Conf. on Robotics Learning (CoRL)},

  year          = 2018,

  month         = oct

}

```

You can find a pdf of the paper [here](http://rpg.ifi.uzh.ch/docs/CORL18_Rebecq.pdf). If you use any of this code, please cite this publication.

## Python Bindings

Python bindings for the event camera simulator can be found [here](https://github.com/uzh-rpg/rpg_vid2e). 

We now also support GPU support for fully parallel event generation!

## Features

- Accurate event simulation, guaranteed by the tight integration between the rendering engine and the event simulator

- Inertial Measurement Unit (IMU) simulation

- Support for multi-camera systems

- Ground truth camera poses, IMU biases, angular/linear velocities, depth maps, and optic flow maps

- Support for camera distortion (only planar and panoramic renderers)

- Different C+/C- contrast thresholds

- Basic noise simulation for event cameras (based on additive Gaussian noise on the contrast threshold)

- Motion blur simulation

- Publish to ROS and/or save data to rosbag

## Install

Installation instructions can be found in [our wiki](https://github.com/uzh-rpg/rpg_esim/wiki/Installation).

## Run

Specific instructions to run the simulator depending on the chosen rendering engine can be found in [our wiki](https://github.com/uzh-rpg/rpg_esim/wiki).

## Acknowledgements

We thank Raffael Theiler and Dario Brescianini for their contributions to ESIM.

This research was supported by by Swiss National Center of Competence Research Robotics (NCCR), Qualcomm (through the Qualcomm Innovation Fellowship Award 2018), the SNSF-ERC Starting Grant and DARPA FLA.

A significant part of ESIM uses components (spline trajectories, inertial measurement unit simulation, various utility functions) from the [ze_oss](https://github.com/zurich-eye/ze_oss) project.

ESIM depends on [UnrealCV](https://github.com/unrealcv/unrealcv) for the photorealistic rendering engine.

We also reused some [code samples](https://github.com/JoeyDeVries/LearnOpenGL.git) from the excellent [Lean OpenGL](https://learnopengl.com/) tutorial in our OpenGL rendering engine.

Finally, ESIM depends on the [Open Asset Import Library (assimp)](https://github.com/assimp/assimp) to load 3D models and Blender scenes within the OpenGL rendering engine.