https://github.com/virgiledjimgou/pii
Pii XR – Remote Industrial Guidance in Augmented Reality. Pii XR is a lightweight, real-time remote support platform designed for industrial environments where operators need expert assistance to solve robotic or mechanical issues.
https://github.com/virgiledjimgou/pii
artificial-intelligence augmented-images augmented-reality-applications computer-vision industry iot-application webrtc-video
Last synced: 3 months ago
JSON representation
Pii XR – Remote Industrial Guidance in Augmented Reality. Pii XR is a lightweight, real-time remote support platform designed for industrial environments where operators need expert assistance to solve robotic or mechanical issues.
- Host: GitHub
- URL: https://github.com/virgiledjimgou/pii
- Owner: VirgileDjimgou
- Created: 2025-04-22T13:55:01.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2025-07-09T09:44:52.000Z (3 months ago)
- Last Synced: 2025-07-09T10:44:27.545Z (3 months ago)
- Topics: artificial-intelligence, augmented-images, augmented-reality-applications, computer-vision, industry, iot-application, webrtc-video
- Language: Vue
- Homepage:
- Size: 6.25 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Pii XR– Remote Industrial Guidance in Augmented Reality
Vue.js + Three.js + AR.js + MQTT + Net.Core + ASP.NET Core
Pii XR is a lightweight, real-time **remote support platform** designed for industrial environments where operators need expert assistance to solve robotic or mechanical issues.
It enables technicians on the shop floor to stream their camera view via a mobile AR interface, while remote experts can overlay visual guidance (arrows, zones, annotations) aligned with the real-world context.
## 🎯 Project Scope (Real-World + Lightweight)
This project is **not** meant to replace full-scale AR headsets or proprietary maintenance systems.
Instead, it provides:
- 📱 A low-barrier, browser-based AR solution for field technicians using smartphones
- 🧑💻 A web interface for remote experts to annotate live video feeds
- 🔁 Real-time bidirectional communication using MQTT and WebRTC
- 🔧 Easy deployment on mobile or desktop with Capacitor or Electron
## 🧩 Core Modules
### Frontend (Vue.js + Three.js + AR.js)
- 🎥 ARClient — Activates smartphone camera and tracks physical markers or surfaces
- 🧭 AnnotationOverlay — Displays arrows, highlights, or text notes in sync with real-world coordinates
- 🌍 ThreeScene — Renders interactive 3D overlays with Three.js
- 📡 MqttSyncClient — Receives commands and annotation data from remote expert
- 🧩 WebRTCModule — Streams live video feed to support interface (optional)
### Expert Dashboard (Web/Desktop)
- 🖥 AnnotationPanel — Lets the remote expert draw, annotate, and guide in real-time
- 📡 MqttPublisher — Sends annotation coordinates and messages to mobile
- 🎥 VideoFeedViewer — Displays incoming WebRTC video stream from field technician
### Backend (Optional)
- 💬 MQTT Broker — Central message relay (Mosquitto or HiveMQ)
- 🧠 AnnotationBridge — Optional Node.js or ASP.NET Core relay to log sessions, events, and diagnostics
- 📚 SessionLogger — Saves annotation and help session data for future review
## 📚 Example Interaction Flow
1. Technician opens **Pii XR mobile app** and scans the robot with AR.js
2. Remote expert opens dashboard and sees the video stream
3. Expert clicks “Draw arrow” pointing to a faulty screw
4. A message is sent via MQTT:
```json
{ "type": "annotation", "shape": "arrow", "position": { "x": 0.4, "y": 1.2, "z": -0.6 } }
```
5. Arrow appears live in technician's AR view aligned with robot
## 🔗 Technologies
- Vue 3 + TypeScript + Three.js + AR.js
- Capacitor (Android build)
- WebRTC (video stream)
- MQTT (Mosquitto or HiveMQ)
- Optional backend: ASP.NET Core or Node.js
- Docker (for Mosquitto, backend services)
## 💡 Use Cases
- 🛠 Remote machine diagnostics
- 🤝 Expert-guided assembly or maintenance
- 📚 Training new technicians with AR overlay
- 📡 AR-enabled support in resource-limited areas