An open API service indexing awesome lists of open source software.

https://github.com/vlad1343/rest-quest

Rest Quest is an emotion-aware wellness travel concierge that transforms how users feel into personalized retreat recommendations, combining a cinematic React experience with on-device emotion and voice analysis for a human-like, privacy-first planning flow.
https://github.com/vlad1343/rest-quest

computer-vision emotion-recognition greatunihack hackathon llm python react traveltech

Last synced: 3 months ago
JSON representation

Rest Quest is an emotion-aware wellness travel concierge that transforms how users feel into personalized retreat recommendations, combining a cinematic React experience with on-device emotion and voice analysis for a human-like, privacy-first planning flow.

Awesome Lists containing this project

README

          

# **Rest Quest**

> **๐Ÿฅ‰ 3rd Place** at the **GreatUniHack 2025** โ€” **Booking.com Challenge**
---

## ๐Ÿš€ Overview

![Booking Summary](photos/photo4.png)
**Rest Quest** is a dual-surface, emotion-aware concierge that closes the gap between how travelers feel and how they plan wellness escapes. The React SPA delivers a cinematic, tactile journey from emotional check-in to curated retreat decks, while the Python toolkit captures facial cues, transcribes live audio with ElevenLabs, and asks Gemini-powered follow-ups that feel like a human concierge. Together they reduce decision fatigue, surface hyper-personal rituals, and keep every interaction privacy-aware on-device.

---

## ๐Ÿ’ก Core Features

### ๐ŸŒŠ Emotionally Intelligent Hero

![Booking Summary](photos/photo3.jpg)

- FlowPattern ribbons, ParticleField fog, and an animated RestQuestLogo breathe with the guest.
- AmbientCursor + CinematicJourney sync gradients, parallax focus, and SpiritBird trails as visitors scroll.

### ๐Ÿง  Emotional Check-In & Analysis Lab

![Booking Summary](photos/photo2.jpg)

- Glassmorphic journal chat with empathy typing, ambient soundscapes, and breathing overlay (press `Space`).
- `mockEmotionAnalysis` transforms journal text into stress/energy/valence scores powering RadialProgress gauges, trigger bar charts (Recharts), and focus-tag recommendations.

### ๐ŸŽฏ Conversational Preferences & Recommendation Deck

![Booking Summary](photos/photo1.jpg)

- `PreferencesContext` stores travel moods, ritual pace, destination search, and intensity sliders with celebratory micro-interactions via Framer Motion.
- Tinder-style swipe deck driven by `useCardSwipe`, @use-gesture/react, undo history, โ€œLearn Moreโ€ modals, and priority lists for premium retreats.

### ๐Ÿง˜โ€โ™€๏ธ Celebration, Booking, and Ritual Wrap-Up

- Booking Summary compares saved experiences, opens itinerary modals, and highlights priority tags.
- CelebrationSection fires particle bursts, breathing cues, and CTA buttons once enough likes are tracked.

### ๐ŸŽฅ Emotion & Voice Toolkit (Python)

- `project/camera.py` mixes OpenCV, MediaPipe, DeepFace, and FER fallback to log emotion spectrums per answer.
- ElevenLabs STT/TTS + Gemini prompts (via `elabs1.py` and `gemini_client1.py`) capture, transcribe, and narrate follow-up questions and travel suggestions in seconds.
- Mock mode lets teams demo the flow without heavy ML dependencies or API keys.

---

## ๐Ÿ—๏ธ Tech Stack

| Layer | Technologies |
|:------|:-------------|
| **Frontend Runtime** | React 18, Vite, JSX, Context API |
| **Styling & Motion** | Tailwind CSS, custom globals, Framer Motion, @react-spring/web |
| **Interaction** | @use-gesture/react, Lottie-react, Lucide-react, Recharts |
| **State & Data** | EmotionalContext, PreferencesContext, ExperiencesContext, localStorage |
| **Toolkit Runtime** | Python 3.10+, OpenCV, MediaPipe, DeepFace, FER, TensorFlow 2.15 |
| **Speech & LLM** | ElevenLabs STT/TTS SDK, Google Gemini (Flash Lite), dotenv |
| **Audio & I/O** | sounddevice, numpy, threading warmups, mock video fallbacks |

---

## ๐Ÿง  Why Rest Quest Stands Out

โœ… **Full-sensory UI** โ€” cinematic gradients, particle fog, and SpiritBird trails respond to every section.
โœ… **Emotion-first recommendations** โ€” keyword analysis drives biometrics, triggers, and retreat focus tags.
โœ… **Swipeable concierge** โ€” likes, super-likes, undo, and saved-match overlays mirror best-in-class travel apps.
โœ… **On-device privacy** โ€” journaling stays local; Python toolkit runs camera + audio processing without cloud uploads.
โœ… **LLM-guided empathy** โ€” Gemini follow-ups adopt a calm, concierge tone powered by reproducible prompts.
โœ… **Inclusive interactions** โ€” reduced-motion support, keyboard controls, ambient sound toggles, and screen-reader friendly structure.

---

## ๐Ÿ… Wellness Milestones

| **Milestone** | **Criteria** |
|---------------|--------------|
| First Breath | Complete the Emotional Check-In journey |
| Ritual Curator | Save 3+ experiences to the liked stack |
| Priority Seeker | Mark at least two retreats as priority |
| Breathing Master | Trigger the breathing overlay three times via `Space` |
| Globe Collector | Explore five destination suggestions in Preferences |
| Calm Analyst | Unlock the Analysis Lab after two journal submissions |
| Celebration Spark | Reach CelebrationSection with โ‰ฅ3 liked retreats |

---

## ๐ŸŒ Guest Journey

1. **Landing Ritual** โ€“ FlowPattern hero, breathing orb, and CTA to โ€œBegin Emotional Scan.โ€
2. **Emotional Check-In** โ€“ Guests journal or speak; AI echo responds with quantified stress + guidance.
3. **Preferences Dialogue** โ€“ Sliders, pills, and suggestions capture mood, pace, and desired rituals.
4. **Analysis Lab** โ€“ Concentric biometrics, trigger charts, and focus tags explain the AI diagnosis.
5. **Recommendation Deck** โ€“ Swipeable cards with gesture, keyboard, and modal controls capture intent.
6. **Booking & Celebration** โ€“ Saved stack becomes comparison tables, itinerary modals, and celebratory cues.
7. **Emotion CLI** โ€“ Optional live session logs facial cues + transcripts for concierge follow-up.

---

## ๐Ÿ”ฎ Future Enhancements

- ๐Ÿฉบ **Live sentiment fusion** โ€” pipe ElevenLabs/Gemini transcripts directly into the SPAโ€™s `EmotionalContext`.
- ๐Ÿ“ **Geo-personalized content** โ€” integrate map previews and flight sourcing for each retreat card.
- ๐ŸŽง **Adaptive soundscapes** โ€” sync AmbientSoundscape layers with real stress/energy telemetry.
- โ˜๏ธ **Persistent profiles** โ€” push liked stacks and questionnaires to Supabase / Firestore for multi-device continuity.
- ๐Ÿ“Š **Session analytics dashboard** โ€” render `project/emotion_results.jsonl` inside the SPA for concierge review.
- ๐Ÿ“ฑ **Companion mobile shell** โ€” wrap the SPA in Capacitor/Expo for in-resort kiosks.