https://github.com/introlab/rendezvous
Next generation videoconference system
https://github.com/introlab/rendezvous
c-plus-plus camera dewarping-library human-detection jetson localization microphones odas speech-to-text stenography video-recording videoconference yolov3
Last synced: 3 days ago
JSON representation
Next generation videoconference system
- Host: GitHub
- URL: https://github.com/introlab/rendezvous
- Owner: introlab
- License: gpl-3.0
- Created: 2019-01-22T14:45:21.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2022-12-10T07:52:34.000Z (over 2 years ago)
- Last Synced: 2025-03-30T18:44:01.425Z (about 1 month ago)
- Topics: c-plus-plus, camera, dewarping-library, human-detection, jetson, localization, microphones, odas, speech-to-text, stenography, video-recording, videoconference, yolov3
- Language: C
- Homepage:
- Size: 114 MB
- Stars: 24
- Watchers: 5
- Forks: 4
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
[](https://travis-ci.org/introlab/rendezvous)
## Introduction
For our bachelor final project in computer engineering at the University of Sherbrooke, the RendezVoUS team is happy to present you the next generation video-conference system : Steno!
## Description
No more video-conferences filled with technical problems and meetings with multiple people behind the same laptop!
Steno is an intelligent video-conferencing system that allows you to make worry-free calls by using 16 microphones and a 360° camera. The system uses artificial intelligence as well as other technologies to offer an enhanced experience both visually and audibly.
Steno films and records each person individually, then sends everything to the video-conferencing system. It's like if everyone had a webcam! Steno films you dynamically, which means that if you move around the table, it will be able track your voice and position, and make sure all your words and movements are sent to the end users.
## Specifications
### Hardware
- Platform : [Jetson TX2](https://developer.nvidia.com/embedded/jetson-tx2-developer-kit)
- Sound card : [16SoundsUSB](https://github.com/introlab/16SoundsUSB)
- Microphones (x16) : [xSoundsMicrophones](https://github.com/introlab/xSoundsMicrophones)
- Audio amplifiers (x2) : [Stereo 20W Class D Audio Amplifier - MAX9744](https://www.adafruit.com/product/1752)
- Speakers (x4) : [Yeeco 2.5 inch 4 ohm stero audio speakers](https://www.amazon.ca/dp/B075B72J5F/ref=pe_3034960_233709270_TE_item)
- Camera : [See3CAM_CU135 – 4K Custom Lens USB 3.0 Camera Board (Color)](https://www.e-consystems.com/4k-usb-camera.asp)
- Lens : [Cvivid Lenses 1.2mm Wide Angle 220 Degree Fisheye](https://www.amazon.ca/dp/B07DN9542G/ref=pe_3034960_233709270_TE_item)
### Software
- Operating system : [JetPack 4.2.2](https://developer.nvidia.com/embedded/jetpack-archive)
- Sound source localisation, tracking, separation and post-filtering : [ODAS](https://github.com/introlab/odas)
- Neural network framework : [Darknet](https://github.com/pjreddie/darknet)
- Real-time person detection : [YOLO](https://github.com/pjreddie/darknet/wiki/YOLO:-Real-Time-Object-Detection)
- Echo and noise cancelling : [Pulse Audio](https://www.freedesktop.org/wiki/Software/PulseAudio/)
- Virtual devices : [V4l2](https://github.com/mpromonet/libv4l2cpp)
- WebRTC video-conference web server : [Jitsi Meet](https://github.com/jitsi/jitsi-meet)
- Graphical user interfaces : [Qt](https://www.qt.io/)
## The Prototype
## Build and Run
See the [wiki](https://github.com/introlab/rendezvous/wiki) for more.
## Licensing
GNU General Public License v3.0; see [`LICENSE`](LICENSE) for details.