https://github.com/deanthecoder/holoframe

A real view into a virtual world.
https://github.com/deanthecoder/holoframe

3d-graphics head-tracking panda3d virtual-reality virtual-window

Last synced: 8 months ago
JSON representation

A real view into a virtual world.

• Host: GitHub
• URL: https://github.com/deanthecoder/holoframe
• Owner: deanthecoder
• License: mit
• Created: 2025-09-19T17:28:10.000Z (9 months ago)
• Default Branch: main
• Last Pushed: 2025-09-27T17:06:38.000Z (9 months ago)
• Last Synced: 2025-09-27T18:29:50.652Z (9 months ago)
• Topics: 3d-graphics, head-tracking, panda3d, virtual-reality, virtual-window
• Language: Python
• Homepage: https://github.com/deanthecoder/HoloFrame
• Size: 419 KB
• Stars: 0
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Agents: agents.md

Awesome Lists containing this project

README

          
[![Twitter URL](https://img.shields.io/twitter/url/https/twitter.com/deanthecoder.svg?style=social&label=Follow%20%40deanthecoder)](https://twitter.com/deanthecoder)

# HoloFrame

An experimental [Panda3D](https://www.panda3d.org/) showcase that turns your monitor into a faux holographic window. HoloFrame combines real-time head tracking, a [Cornell box](https://en.wikipedia.org/wiki/Cornell_box) inspired scene, and configurable room dimensions to keep a 3D model anchored in space as you move.

## Features

- Head pose tracking (MediaPipe + OpenCV) drives the virtual camera position.

- Full-screen windowed Panda3D viewport with adjustable room dimensions.

- Cornell-style lighting with a ceiling panel placeholder for the key light.

- Minimal HUD with FPS, camera pose readout, and in-app control hints (toggleable).

## Controls

- `ESC` — Quit the application.

- `f` — Toggle fullscreen mode.

- `h` — Toggle HUD visibility.

- `?` (or `Shift-/`) — Toggle on-screen control help.

- Arrow keys — Adjust room width/height.

- `l` / `p` — Pull/push the back wall to tweak room depth.

- `m` — Cycle the active model.

## Screenshot

![HoloFrame in action](img/screen.png)

## Getting Started

1. Install dependencies:

   ```bash

   python3 -m pip install --upgrade pip

   pip install opencv-python mediapipe numpy panda3d

   ```

2. Launch the app:

   ```bash

   python3 HoloFrame.py

   ```

Make sure your webcam is accessible; the app will exit if a camera stream cannot be opened.

## How It Works

1. Read frames from the default webcam using OpenCV.

2. Run face tracking to estimate the user's head position in each frame.

3. Convert the detected head pose into the Panda3D coordinate space.

4. Update the virtual camera transform so the scene matches the user's viewpoint.

5. Render the Cornell box scene and selected model with the new perspective.