An open API service indexing awesome lists of open source software.

https://github.com/coder12git/vaidya

Vaidya - An Gen AI-based medical assistant that works without the internet, accessible via a simple phone call.
https://github.com/coder12git/vaidya

Last synced: 3 months ago
JSON representation

Vaidya - An Gen AI-based medical assistant that works without the internet, accessible via a simple phone call.

Awesome Lists containing this project

README

        


![Screenshot 2025-02-23 091532](https://github.com/user-attachments/assets/3cf5538e-01a5-48eb-ac11-71d4d3e1f771)



A Gen AI-based medical assistant that works without the internet, accessible via a simple phone call.

Watch Demo Video - Click here


Website - https://vaidya-83rp.vercel.app/


Backend deploy server link - https://vaidya-gamma.vercel.app/

To use our app, send an sms or voice call on this number - `+19283796252`


## Project Overview
Millions of people, especially in low-resource settings, struggle to access timely and reliable medical guidance due to **language barriers**, **lack of internet connectivity,** and **limited access to smart devices**. In emergencies and routine health queries alike, users need immediate, understandable, and trustworthy advice that traditional systems often fail to provide.

- Globally, over **3.7 billion people still do not have internet access** (ITU estimates).
- In India, despite rapid digital growth, more than **700 million people remain offline**, limiting access to digital health resources.
- In many low-resource settings, the **shortage of medical professionals is stark**.
- Approximately 40% of the world's population speaks a language underrepresented online, meaning many **digital health tools aren't available in their native language**.

## Features

- **Voice-Based AI Assistance**:
Sahayak uses programmable voice to offer a fully voice-activated interface that works even on basic phones, without internet.

- **Multilingual Support**:
Users can select their preferred language (English, Hindi, etc) at the start of the call, ensuring that all communication - including symptom queries and first-aid instructions, is delivered in their language.

- **Integrated Medical Guidance**:
Leveraging the Gemini API , Sahayak provides real-time general medical guidance for symptom-related queries while strictly avoiding diagnoses.

- **Emergency & Direct Connectivity**:
The system not only offers first-aid instructions for common emergencies (e.g., burns, cuts, fever, dehydration) but also connects users directly to doctors or emergency services if needed.

- **Location-Based Services**:
With integrated Google Maps API, Sahayak can quickly find nearby hospitals and clinics and send details (name, address, phone number) via SMS.

- **SMS Support**:
All guidance and details are also sent via SMS, ensuring users have a permanent record of their medical advice - even if they miss the voice call.

## How It Works

![flowchart](https://github.com/user-attachments/assets/71080043-94fb-4e5e-8c57-c86bedd51d2e)

## Technology Stack
- **Node.js and Express** – For building our ( backend )server.
- **Twilio Programmable Voice & Messaging** – For voice calls, DTMF input handling, and sending SMS messages.
- **Google Generative AI (Gemini API)** – To generate AI-driven medical guidance responses.
- **Google Places API** – To fetch nearby hospital and clinic details based on location.
- **Ngrok** – For exposing the local development server to the internet during testing.
- **React.js** –For building our webpage ( frontend )

Screenshots demonstrating the functionality of our backend server

![m1](https://github.com/user-attachments/assets/aa93d7db-b009-46e1-8137-38ccdfebb275)

![m2](https://github.com/user-attachments/assets/d1973fdc-f440-44ea-8580-8209e23bfabe)

![m3](https://github.com/user-attachments/assets/f53f6f8b-4a71-4631-ab2c-2200982dc451)

![m4](https://github.com/user-attachments/assets/948672c8-3f54-44c1-805d-8649fda945da)

![m5](https://github.com/user-attachments/assets/f417a037-4828-4ee8-9fe1-8f3ba946b963)

![m6](https://github.com/user-attachments/assets/4e286d98-b6e8-4ef3-b2e8-c2bfb498aac1)

![Screenshot 2025-02-23 130356](https://github.com/user-attachments/assets/253ad188-7a3c-46fd-94c7-86e079e9d657)

![Screenshot 2025-02-23 130407](https://github.com/user-attachments/assets/fa623fa1-ad86-4245-82a9-36cbe62b7d8e)

![Screenshot 2025-02-23 130931](https://github.com/user-attachments/assets/af9e3ddb-31a1-49a2-b0e7-9c19bcdf76c6)

![Screenshot 2025-02-23 130953](https://github.com/user-attachments/assets/38277977-554e-45db-b280-09fe8e09df4c)

Screenshots demonstrating the functionality of our website

![Screenshot 2025-02-23 114630 1](https://github.com/user-attachments/assets/3e14a979-02d6-4b7e-a459-b67f07316677)
![Screenshot 2025-02-23 114700 1](https://github.com/user-attachments/assets/741d54ef-4b71-40f8-9fd4-3ae277df4c61)
![Screenshot 2025-02-23 114720 1](https://github.com/user-attachments/assets/5e57de1e-06b5-4848-ac89-5f92984ea430)
![Screenshot 2025-02-23 114809 1](https://github.com/user-attachments/assets/08ca65ab-64da-4f4f-9837-1fa50fa68c58)
![Screenshot 2025-02-23 114834 2](https://github.com/user-attachments/assets/f9ec5b06-ebdd-43a9-b61d-c11838882b1c)
![Screenshot 2025-02-23 114850 1](https://github.com/user-attachments/assets/3051099d-547c-45ac-a9a4-1f1db1842d26)
![Screenshot 2025-02-23 114904 1](https://github.com/user-attachments/assets/5be99cc6-e999-408a-a04d-3291f42c3d29)
![Screenshot 2025-02-23 114916 2](https://github.com/user-attachments/assets/e914b444-5d3a-4a9d-9c2c-53d9f9424ec9)
![Screenshot 2025-02-23 114937 1](https://github.com/user-attachments/assets/cba716ea-58d0-4b43-ba39-c1e0f0f7565f)
![dash 1](https://github.com/user-attachments/assets/46783686-5fa7-4e75-883c-c70b4e06144d)

Demo Video

**Here is our Demo Video**

Link : https://youtu.be/9PLBbNzp2XA?si=XnxsvSGGu4Ci3PVj