https://github.com/junaidmancheri/onboardly-service

An Agentic-AI service for onboarding users by enabling a conversational interface
https://github.com/junaidmancheri/onboardly-service

agentic-ai biometric-authentication gemini-api google-cloud-storage google-vision-api speech-to-text text-to-speech twilio-api

Last synced: 9 months ago
JSON representation

An Agentic-AI service for onboarding users by enabling a conversational interface

• Host: GitHub
• URL: https://github.com/junaidmancheri/onboardly-service
• Owner: JunaidMancheri
• Created: 2024-12-02T14:14:01.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2025-03-11T04:00:13.000Z (over 1 year ago)
• Last Synced: 2025-03-30T00:18:13.467Z (over 1 year ago)
• Topics: agentic-ai, biometric-authentication, gemini-api, google-cloud-storage, google-vision-api, speech-to-text, text-to-speech, twilio-api
• Language: JavaScript
• Homepage:
• Size: 143 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Onboarding-User Service | AI Agent

An intelligent AI-driven onboarding service designed to streamline user registration by collecting and verifying essential details. The agent interacts with users through natural language processing, verifies credentials, and enriches user profiles using public data sources.

## Engineering & Technology Stack

Onboarding-User Service is built with **multi-modal AI capabilities**, ensuring an interactive, secure, and automated onboarding process.

### **Architecture & Design**

- **AI-Powered NLP** using Google's **Gemini** foundation model for seamless user interactions.

- **Multi-Modal Capabilities** including text, voice, and image processing for a dynamic user experience.

### **Core Functionalities**

- **User Data Collection:** Captures email, phone number, image, name, user type (Individual, Industry, or Institution), and location.

- **Verification Services:**

  - **Twilio** for phone number verification via OTP.

  - **Nodemailer** for email verification.

- **Location Detection:** Automatically retrieves user location using **Google Maps API**.

- **Biometric Authentication:** Captures and processes images for secure identity verification.

- **Identity Parsing & Storage:** Extracts details from government-issued IDs and securely stores them in **Google Cloud**.

- **Voice Interaction:**

  - **Speech-to-Text (STT)** for user voice input.

  - **Text-to-Speech (TTS)** for AI-generated responses, enabling smooth conversations.

- **Profile Enrichment:** Leverages public sources like **LinkedIn** to enhance user profiles based on collected data.

### **Technology Stack**

- **AI & NLP:** Gemini (Google’s foundation model) for natural language understanding.

- **Backend:** Node.js with Express.js for robust API services.

- **Database:** MongoDB for scalable data storage.

- **Authentication & Security:**

  - Biometric authentication for identity verification.

  - Twilio (Phone Verification) & Nodemailer (Email Verification).

- **Cloud & Infrastructure:**

  - Google Cloud Storage for secure document and ID storage.

  - Google Maps API for automated location retrieval.

- **Communication:** Twilio (SMS/Voice) and Google TTS/STT for multimodal interaction.

Onboarding-User Service is designed to provide **a highly secure, interactive, and automated onboarding experience**, ensuring seamless user verification and profile management.