https://github.com/rudra496/sightlineai

👁️ SightlineAI — AI smart glasses for the blind. Real-time object detection, text-to-speech, navigation assistance. Open-source assistive technology for 2.2B+ visually impaired people.
https://github.com/rudra496/sightlineai

accessibility ai assistive-ai assistive-technology blind computer-vision deep-learning esp32 hacktoberfest html iot iot-wearable navigation object-detection open-source smart-glasses text-to-speech visual-impairment wearable yolo

Last synced: 16 days ago
JSON representation

👁️ SightlineAI — AI smart glasses for the blind. Real-time object detection, text-to-speech, navigation assistance. Open-source assistive technology for 2.2B+ visually impaired people.

• Host: GitHub
• URL: https://github.com/rudra496/sightlineai
• Owner: rudra496
• License: mit
• Created: 2026-01-30T19:30:13.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2026-06-05T16:49:44.000Z (19 days ago)
• Last Synced: 2026-06-05T18:45:05.549Z (19 days ago)
• Topics: accessibility, ai, assistive-ai, assistive-technology, blind, computer-vision, deep-learning, esp32, hacktoberfest, html, iot, iot-wearable, navigation, object-detection, open-source, smart-glasses, text-to-speech, visual-impairment, wearable, yolo
• Language: Python
• Homepage: https://rudra496.github.io/sightlineai/
• Size: 213 KB
• Stars: 2
• Watchers: 0
• Forks: 0
• Open Issues: 9
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • Contributing: CONTRIBUTING.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Security: SECURITY.md
  • Support: SUPPORT.md
  • Roadmap: ROADMAP.md

Awesome Lists containing this project

README

          
👁️ SightlineAI

AI-Powered Accessibility Guidance Platform for the Visually Impaired


Empowering independent navigation through multimodal artificial intelligence.

"🌐 Live Demo" (https://rudra496.github.io/sightlineai) •

"📖 Documentation" (https://github.com/rudra496/sightlineai) •

"🐛 Report Issue" (https://github.com/rudra496/sightlineai/issues) •

"💡 Feature Request" (https://github.com/rudra496/sightlineai/issues)

"License" (https://img.shields.io/badge/License-MIT-green.svg)

"Python" (https://img.shields.io/badge/Python-3.11+-blue.svg)

"FastAPI" (https://img.shields.io/badge/FastAPI-Modern_API-009688.svg)

"Open Source" (https://img.shields.io/badge/Open%20Source-Yes-success.svg)

"AI" (https://img.shields.io/badge/AI-Gemini%20%7C%20Qwen-purple.svg)

---


🌟 Overview

SightlineAI is an open-source accessibility platform designed to help blind and visually impaired individuals better understand, navigate, and interact with their surroundings.

By combining computer vision, OCR, conversational AI, and navigation intelligence, SightlineAI transforms ordinary devices into intelligent accessibility companions capable of delivering real-time environmental awareness and guidance.

---

🚀 Key Features

- 👁️ Real-time scene understanding

- 📄 OCR and document reading assistance

- ⚠️ Obstacle and hazard awareness

- 🗺️ Context-aware navigation support

- 💬 Conversational AI assistance

- 🌐 Multi-language accessibility support

- 🔄 Offline fallback capabilities

- ⚡ Real-time WebSocket communication

---

🧠 AI Architecture

SightlineAI follows a multi-model architecture that supports multiple AI providers.

Supported Models

Provider| Capability

Google Gemini| Multimodal reasoning, scene understanding, accessibility guidance

Qwen| Vision analysis, conversational intelligence, contextual assistance

This provider-agnostic design improves flexibility, reliability, and future scalability.

---

🏗️ System Workflow

Camera / Voice Input

          ↓

Visual & Context Processing

          ↓

Gemini / Qwen AI Analysis

          ↓

Risk & Accessibility Assessment

          ↓

Voice and Text Guidance

---

🌍 Impact

SightlineAI addresses accessibility challenges faced by more than 285 million visually impaired people worldwide, particularly in regions where advanced assistive technologies remain financially inaccessible.

United Nations SDGs

- 💚 SDG 3 – Good Health & Well-Being

- ❤️ SDG 10 – Reduced Inequalities

- 💛 SDG 11 – Sustainable Cities & Communities

---

🛠️ Technology Stack

Category| Technologies

Backend| Python, FastAPI

Frontend| React, HTML, CSS, JavaScript

AI Models| Google Gemini, Qwen

Vision| OCR, Computer Vision

Infrastructure| Docker, Redis

Database| SQLite, PostgreSQL

Navigation| OpenStreetMap

---

⚙️ Quick Start

git clone https://github.com/rudra496/sightlineai.git

cd sightlineai

cp .env.example .env

pip install -r requirements.txt

python -m app.main

---

🤝 Contributing

Contributions are welcome.

Areas of contribution include:

- Accessibility improvements

- AI model enhancements

- Documentation

- Localization

- Bug fixes

- UI/UX improvements

---

📄 License

Released under the MIT License.

---

👨‍💻 Maintainer

Rudra Sarker

Industrial & Production Engineering

Shahjalal University of Science and Technology (SUST)

🌐 Portfolio: https://rudra496.github.io/site

🐙 GitHub: https://github.com/rudra496

💼 LinkedIn: https://www.linkedin.com/in/rudrasarker

📧 Email: rudrasarker130@gmail.com

---

Built for accessibility. Built for independence. Built for impact.