https://github.com/studiolanes/vision-utils

Scripts to convert 2D images and videos into Spatial versions
https://github.com/studiolanes/vision-utils

depth-anything spatial spatial-computing spatial-photo spatial-video vision-pro visionos

Last synced: 1 day ago
JSON representation

Scripts to convert 2D images and videos into Spatial versions

• Host: GitHub
• URL: https://github.com/studiolanes/vision-utils
• Owner: studiolanes
• License: mit
• Created: 2024-02-14T02:35:48.000Z (12 months ago)
• Default Branch: main
• Last Pushed: 2024-11-22T22:46:39.000Z (2 months ago)
• Last Synced: 2025-01-16T05:06:35.243Z (8 days ago)
• Topics: depth-anything, spatial, spatial-computing, spatial-photo, spatial-video, vision-pro, visionos
• Language: Jupyter Notebook
• Homepage: https://blog.studiolanes.com/spatial
• Size: 1.68 MB
• Stars: 87
• Watchers: 7
• Forks: 8
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
```

 __   _(_)___(_) ___  _ __    _   _| |_(_) |___

 \ \ / / / __| |/ _ \| '_ \  | | | | __| | / __|

  \ V /| \__ \ | (_) | | | | | |_| | |_| | \__ \

   \_/ |_|___/_|\___/|_| |_|  \__,_|\__|_|_|___/

```

# vision-utils

This repo contains various projects related to the Vision Pro & visionOS.

## Content

- [Convert a 2D Photo to Spatial Photo](./spatialconverter/)

- [Convert a 2D Video to Spatial Video](./spatialconverter/)

- [CLI to generate a stereoscopic image](./picCombiner)

- [visionOS Icons](./icons)

## 2D to Spatial Content

Convert any photos to spatial photos and videos viewable in the Apple Vision Pro! There is a mini swift cli executable that works on M1 apple computers to attach png files together.

See [Photo Blog Post](https://blog.studiolanes.com/posts/2d-to-spatial-photos) and [Video Blog Post](https://blog.studiolanes.com/posts/converting-spatial-videos) for more info.

### Dependencies

We borrow the executable and iPhone args from [Mike Swanson](https://blog.mikeswanson.com/spatial) for converting over under videos to spatial videos.

We assume that you have [poetry](https://github.com/python-poetry/poetry) globally installed for python packaging and you're using Python 3.

```bash

cd spatialconverter

poetry install

poetry shell

# Poetry breaks when trying to install transformers from source, so run this installation the first time

pip install -q git+https://github.com/huggingface/transformers.git

```

### Subsequent runs

```bash

cd spatialconverter/spatialconverter

poetry shell

python main.py --photo /Users/herk/Downloads/photo.png

# python main.py --video /Users/herk/Downloads/skydive.mp4

```