https://github.com/zlogic/matrix-eyes

https://github.com/zlogic/matrix-eyes

autostereogram midas

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/zlogic/matrix-eyes
• Owner: zlogic
• License: apache-2.0
• Created: 2023-01-21T13:23:51.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-11-12T23:00:22.000Z (about 2 months ago)
• Last Synced: 2024-11-12T23:31:40.287Z (about 2 months ago)
• Topics: autostereogram, midas
• Language: Python
• Homepage:
• Size: 7.99 MB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Matrix Eyes

Matrix Eyes is a weekend project to convert a photo image into an [autostereogram](https://en.wikipedia.org/wiki/Autostereogram).

Using the [MiDaS](https://arxiv.org/abs/1907.01341) and [Apple Depth Pro](https://arxiv.org/abs/2410.02073) depth estimation algorithms.

# Instructions

## Installation

```shell

pip install -r requirements.txt

```

For MiDaS, install `opencv-python` as well:

```shell

pip install opencv-python

```

For Depth Pro, download the model checkpoints:

```shell

mkdir checkpoints

curl -LJ -o checkpoints/depth_pro.pt https://ml-site.cdn-apple.com/models/depth-pro/depth_pro.pt

```

## Usage

To use a custom Torch home directory, set the `TORCH_HOME` environment variable.

To gerate a depth image, run:

```shell

python main.py [--model-type=Depth_Pro|DPT_Large|DPT_Hybrid|MiDaS_small] [--output-format=image|stereogram|mesh] [--stereo-amplitude=]  

```

replacing `` with the source image filename, and `` with the output destination filename.

Additional (optional) arguments:

* `model-type` specifies one of the MiDaS models

    * `Depth_Pro` will use Depth Pro (alternative to MiDaS)

    * `DPT_Large` will use MiDaS v3 - Large (highest accuracy, slowest inference speed); default

    * `DPT_Hybrid` will use MiDaS v3 - Hybrid (medium accuracy, medium inference speed)

    * `MiDaS_small` will use MiDaS v2.1 - Small (lowest accuracy, highest inference speed)

* `output-format` specifies what to output

    * `image` will output a depth map image; default

    * `stereogram` will output a stereogram image

    * `mesh` will output a 3D [Wavefront OBJ file](https://en.wikipedia.org/wiki/Wavefront_.obj_file)

* `stereo-amplitude` specifies the maximum offset/depth for stereograms (relative to image width); might need to be reduced if most of the image consists of foreground objects

# Examples

## Image 1

Source image:

![Source image 1](doc/img1.jpg)

Depth data extracted by MiDaS:

![Depth data for image 1](doc/img1.depth.jpg)

Generated stereogram - works best when [viewed in fullscreen](https://raw.githubusercontent.com/zlogic/matrix-eyes/main/doc/img1.stereo.jpg):

![Stereogram for image 1](doc/img1.stereo.jpg)