https://github.com/ishaan0709/vitals_vr_training

VITALS — VR-first full-stack surgical training platform with AI support. Built for the Israel–India Hackathon (Hack4Help) to empower medical students through an AI surgical mentor, responsive web app, and immersive Unity-based VR simulations.
https://github.com/ishaan0709/vitals_vr_training

ai chatbot fastapi hackathon healthcare openai react surgery-training unity vr

Last synced: 3 months ago
JSON representation

VITALS — VR-first full-stack surgical training platform with AI support. Built for the Israel–India Hackathon (Hack4Help) to empower medical students through an AI surgical mentor, responsive web app, and immersive Unity-based VR simulations.

• Host: GitHub
• URL: https://github.com/ishaan0709/vitals_vr_training
• Owner: Ishaan0709
• Created: 2025-08-23T20:06:27.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2025-08-24T00:25:42.000Z (10 months ago)
• Last Synced: 2025-08-24T09:06:09.508Z (10 months ago)
• Topics: ai, chatbot, fastapi, hackathon, healthcare, openai, react, surgery-training, unity, vr
• Language: JavaScript
• Homepage: https://final-med.vercel.app/
• Size: 99.6 KB
• Stars: 0
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
VITALS — AI-Assisted VR Surgical Training Platform

VITALS is a Unity-powered VR training platform designed to give medical students safe, repeatable, and hands-on practice for surgical procedures. Built for the Israel–India Hackathon (Hack4Help), VITALS puts immersive VR simulations at the center and pairs them with a companion web app and an AI Surgical Mentor for step-wise guidance, questions, and feedback.

Live Demos:

VIDEO DEMO - https://youtu.be/WxPbSelgTWY?si=HzvrkJzdvNcQ7JHr

🌐 Main Website: https://final-med.vercel.app

🤖 AI Chatbot: https://medimentor-two.vercel.app

🕶 VR Surgical Simulator: https://medical-vr.vercel.app

📖 Description

Modern medical students face a huge challenge — theory-heavy learning with minimal hands-on surgical exposure. Cadaver training is limited, expensive, and often unavailable. Students enter hospitals underprepared, impacting confidence and patient safety.

VITALS bridges this gap by offering:

Unity-based VR simulator (core): immersive, step-wise surgical practice in a safe, repeatable environment.

AI Surgical Mentor: instant, specialist-informed answers and guidance alongside practice.

Structured WebApp: responsive interface for modules, checklists, and learning flows.

This ensures safe, repeatable, and cost-effective practice opportunities for students worldwide.

✨ Features

VR Simulation (Core) 🎮 — Unity 3D + WebGL with headset support (Meta Quest, HTC Vive, etc.) for immersive surgical training.

AI-powered Chatbot 🤖 — Specialist-informed Q&A and step-wise mentoring during practice.

Personalized Guidance 🧠 — Context-aware learning tailored to the student’s progress.

Full-stack Deployment 🚀 — Frontend on Vercel, Backend API on Render.

Responsive Design 📱💻 — Works seamlessly on mobile & desktop.

Future Haptics & Devices — Designed to plug in haptics and peripherals.

🛠 Tech Stack

VR / Simulation (Core)

Unity 3D + WebGL (PC/Standalone builds supported)

VR headset compatibility: Meta Quest, HTC Vive, etc.

Planned: Haptics & device integrations

Frontend (Vitals_WebApp)

React 18 + Vite (fast dev/build)

Tailwind CSS (utility-first responsive UI)

Hosting: Vercel (edge network)

Backend (Vitals_AI_Bot)

Python (FastAPI) with async REST APIs

CORS + secure environment variables

Hosting: Render (auto-scaling)

AI Model

OpenAI GPT-4 for reasoning & conversational intelligence

Context persistence + prompt engineering for personalized responses

Roadmap: LangChain + Vector DB (RAG) for specialist datasets; pluggable fine-tuned healthcare LLMs

Other

GitHub Actions for CI/CD

Cloud-native deployment architecture

Git for version control & collaboration

🚀 How to Run Locally

1) Clone Repository

git clone https://github.com/Ishaan0709/VITALS.git

cd VITALS

2) Run AI Bot (Backend)

cd Vitals_AI_Bot

pip install -r requirements.txt

uvicorn main:app --reload

3) Run WebApp (Frontend)

cd ../Vitals_WebApp

npm install

npm run dev

4) Run Unity Simulation (VR / WebGL)

cd ../Vitals_Unity_Simulation

📦 Deployment

Frontend (Vitals_WebApp): Vercel

Backend (Vitals_AI_Bot): Render

Simulation: Unity builds (WebGL / Standalone / Mobile VR)