https://github.com/cabelo/visioncom

Computer Vision-Assisted Communication System for Patients with Amyotrophic Lateral Sclerosis
https://github.com/cabelo/visioncom

Last synced: about 1 month ago
JSON representation

Computer Vision-Assisted Communication System for Patients with Amyotrophic Lateral Sclerosis

• Host: GitHub
• URL: https://github.com/cabelo/visioncom
• Owner: cabelo
• License: apache-2.0
• Created: 2024-02-09T17:07:39.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-02-09T17:47:44.000Z (10 months ago)
• Last Synced: 2024-08-01T21:46:05.232Z (4 months ago)
• Language: C++
• Size: 31.3 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-openvino - Visioncom

README

        
# Visioncom

## Under development.

Based in open_model_zoo projetct demo, the assisted communication system employs advanced computer vision technologies, using the OpenCV and OpenVINO libraries, to provide an interactive solution for patients with Amyotrophic Lateral Sclerosis (ALS).

Through OpenCV, an open-source library designed for real-time computer vision applications, the system captures and processes live video images, enabling the identification and tracking of the user's eye movements. 

OpenVINO, an Intel tool for optimizing computer vision inference, works in conjunction with OpenCV to accelerate applications, ensuring quick and efficient responses, which are essential for real-time interaction.

By utilizing the gaze estimation technique, the system can accurately determine the direction of the user's gaze, transforming eye movements into navigation commands through a virtual menu overlaid on the live video.

This approach allows ALS patients to interact with the system intuitively, selecting menu options simply with their gaze. This method not only facilitates communication for individuals with limited mobility but also provides a form of interaction that preserves the user's autonomy, enabling them to express themselves and perform tasks independently, despite the challenges posed by the condition.

[![image](https://github.com/cabelo/visioncom/assets/675645/8049ba49-6699-4fbb-b638-29a747fe7fda)](https://www.youtube.com/watch?v=JbbObeGXfm4)