{"id":31052847,"url":"https://github.com/virgiledjimgou/lyna","last_synced_at":"2025-10-16T01:34:17.906Z","repository":{"id":155261425,"uuid":"278374434","full_name":"VirgileDjimgou/Lyna","owner":"VirgileDjimgou","description":"Lyna is a hybrid AI-powered application that helps car users understand their vehicle’s interior using real-time object detection, enriched explanations (text/audio), and AR-based overlays. This project is built for technicians, rental users, or drivers who want to learn about the cockpit, dashboard symbols.","archived":false,"fork":false,"pushed_at":"2025-07-02T14:59:22.000Z","size":26302,"stargazers_count":0,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-07-02T15:40:58.872Z","etag":null,"topics":["3d-engine","artificial-intelligence","asp-net-core","augmented-reality-application","csharp","digital","hmi","iot-application","mqtt-service","treejs","uml-diagram","virtual","vue3","yolov8"],"latest_commit_sha":null,"homepage":"","language":"Vue","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/VirgileDjimgou.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2020-07-09T13:36:58.000Z","updated_at":"2025-07-02T14:59:25.000Z","dependencies_parsed_at":null,"dependency_job_id":"1c4bb7cd-8483-425d-858b-bfe644b97a2d","html_url":"https://github.com/VirgileDjimgou/Lyna","commit_stats":null,"previous_names":["virgiledjimgou/fabrik3d","virgiledjimgou/simucorelite","virgiledjimgou/driveguidear","virgiledjimgou/lyna"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/VirgileDjimgou/Lyna","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VirgileDjimgou%2FLyna","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VirgileDjimgou%2FLyna/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VirgileDjimgou%2FLyna/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VirgileDjimgou%2FLyna/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/VirgileDjimgou","download_url":"https://codeload.github.com/VirgileDjimgou/Lyna/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VirgileDjimgou%2FLyna/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":275193893,"owners_count":25421413,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-14T02:00:10.474Z","response_time":75,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["3d-engine","artificial-intelligence","asp-net-core","augmented-reality-application","csharp","digital","hmi","iot-application","mqtt-service","treejs","uml-diagram","virtual","vue3","yolov8"],"created_at":"2025-09-15T01:28:33.506Z","updated_at":"2025-10-16T01:34:12.856Z","avatar_url":"https://github.com/VirgileDjimgou.png","language":"Vue","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🚘 Lyna – Augmented Reality Assistant for In-Car Intelligence\n\n**Lyna** is a hybrid AI-powered assistant designed to help users identify and understand the components inside a vehicle using their smartphone camera. By leveraging real-time object detection and an augmented reality overlay, Lyna provides instant feedback about dashboard symbols, control buttons, and cockpit elements — making car interaction intuitive for everyone.\n\n\n## 🎯 Project Overview\n\nLyna combines:\n\n- 📸 Real-time detection of interior car elements (steering wheel, gear shift, AC, warning lights, etc.)\n- 🧠 AI-powered backend (YOLOv8) to identify visual components from live camera input\n- 💬 Enriched information displayed via tooltips and audio hints (text-to-speech)\n- 🧩 Modular hybrid architecture with **Flask (AI)**, **ASP.NET Core (API)**, and **Vue 3 + Capacitor (Frontend)**\n\n\n## 🧠 Architecture Overview\n\n```plaintext\n[Vue 3 + Capacitor Mobile App]\n       ↓ (camera frame)\n[Flask + YOLOv8 Detection API]\n       ↓ (detected object labels)\n[ASP.NET Core API + MongoDB]\n       ↓ (descriptive metadata, audio, icons)\n[Augmented Reality Overlay + TTS Output]\n```\n\n\n## 🧩 Core Modules\n\n### 📱 Mobile App (Vue 3 + Capacitor)\n- Live camera feed\n- Frame capture and API calls\n- 2D/3D overlays (labels + tooltips)\n- Audio output via Web Speech API or Capacitor plugin\n\n### 🧠 AI Detection (Flask + YOLOv8)\n- Receives camera frames (JPEG)\n- Runs YOLOv8 inference\n- Returns bounding boxes + class labels\n\n### 🧰 Metadata API (ASP.NET Core)\n- Exposes detailed metadata for detected objects\n- Handles multilingual text and audio support\n- Connects to MongoDB or serves from enriched JSON\n\n\n## 📦 Example Object Metadata\n\n```json\n{\n  \"id\": \"gear_shift\",\n  \"name\": \"Gear Shift Lever\",\n  \"descriptionShort\": \"Used to change gears.\",\n  \"descriptionLong\": \"This lever allows the driver to select driving modes: Drive (D), Neutral (N), Reverse (R), and Park (P). Some models also support manual or \n             sport mode.\",\n  \"models\": [\"Mazda 3\", \"Toyota Corolla\"],\n  \"icon\": \"gear.svg\",\n  \"audio\": {\n    \"fr\": \"gear_shift_fr.mp3\",\n    \"en\": \"gear_shift_en.mp3\"\n  }\n}\n\n```\n\n## 📂 Folder Structure\n\nLyna-ar/\n├── client-app/           # Vue 3 + Capacitor mobile frontend\n├── backend-ai/           # Flask + YOLOv8 inference API\n├── backend-core/         # ASP.NET Core API (data + metadata)\n├── shared-data/          # JSON, icons, audio resources\n├── docker-compose.yml    # Docker orchestration for all services\n└── README.md             # Project documentation\n\n\n## 🚀 MVP Roadmap\n\n| Week | Deliverables                                                                 |\n|------|------------------------------------------------------------------------------|\n| 1    | Vue + Capacitor app with live camera preview                                 |\n| 2    | Flask backend with YOLOv8 model and /detect endpoint                         |\n| 3    | ASP.NET Core API with enriched vehicle metadata                              |\n| 4    | Integration, audio playback, packaging as APK                                |\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvirgiledjimgou%2Flyna","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvirgiledjimgou%2Flyna","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvirgiledjimgou%2Flyna/lists"}