https://github.com/nosy-b/holography

A small demo using WebXR and Deep Learning to create Holograms of people
https://github.com/nosy-b/holography

Last synced: about 2 months ago
JSON representation

A small demo using WebXR and Deep Learning to create Holograms of people

• Host: GitHub
• URL: https://github.com/nosy-b/holography
• Owner: nosy-b
• Created: 2020-04-27T08:27:25.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2021-02-12T12:03:39.000Z (almost 4 years ago)
• Last Synced: 2024-08-01T02:28:27.046Z (5 months ago)
• Language: JavaScript
• Homepage: https://nosy-b.github.io/holography
• Size: 4.4 MB
• Stars: 226
• Watchers: 12
• Forks: 34
• Open Issues: 6
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# Holography

Simple demo of WebXR and Deep Learning using Tensorflow to create holograms on-the-fly. 

It works on Android with the last Chrome (>= r81)

! REMARK! : I discovered that the possibility to take pictures WHILE in AR Context just works on LG phones surprisingly (https://developers.google.com/ar/discover/supported-devices) as they use the wide angle camera for AR (the phone I used by chance)!! So to use this demo with other phones, take the picture (using usual browser get media api) but before launching the AR Context!

![alt text](https://raw.githubusercontent.com/nosy-b/holography/master/demo.gif "Holography")

DEMO here: http://nosy-b.github.io/holography

## How to

- First be sure to have an android phone with chrome >=r81

- Choose your camera feed (ideally back camera)

- Tap on start AR (the position of your phone at that moment will be the center of the frame)

- Move a bit around if you want to help the space detection

- Look at a human (real or a photo) and tap on the screen

- It should appear coming from your phone to the direction you were looking at when clicked on Start (initial position)

## Description

Small code that create particles for people extracted from camera feed using Bodypix model

Feel free to use this dirty little code for your own experiments

I put demos on my twitter sometimes  https://twitter.com/AlexandreDevaux

## Getting Started

### Dependencies

* ThreeJS, TensorFlowJS

## Help

One thing to be careful about is not to frame too close the subject you want to make a hologram of. The camera frame is smaller than what your screen shows. (A good todo would be to show camera frame while in AR)

## Authors

Alexandre Devaux 

[@AlexandreDevaux](https://twitter.com/AlexandreDevaux)

## Version History

## License

Check the license of THREEJS and Tensorflow