https://github.com/wkentaro/real-harem
Transgender of real persons to achieve real harem, with mixed reality on Hololens.
https://github.com/wkentaro/real-harem
augmented-reality hololens mixed-reality pytorch transgender
Last synced: 2 months ago
JSON representation
Transgender of real persons to achieve real harem, with mixed reality on Hololens.
- Host: GitHub
- URL: https://github.com/wkentaro/real-harem
- Owner: wkentaro
- Created: 2017-11-30T19:04:23.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2018-01-11T04:40:49.000Z (almost 8 years ago)
- Last Synced: 2025-04-09T04:35:48.663Z (6 months ago)
- Topics: augmented-reality, hololens, mixed-reality, pytorch, transgender
- Language: Python
- Homepage:
- Size: 912 KB
- Stars: 4
- Watchers: 5
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# REAL HAREM
*Transgender of real persons to achieve real harem, with mixed reality on Hololens.*
This is a project in
[the lecture "Intelligent Software"](http://www.mi.t.u-tokyo.ac.jp/ushiku/lectures/is/)
at the University of Tokyo in winter 2017.
## Challenges
- [x] Translate gender of person with remaining his/her face characteristic.
- [x] Track face motion in real time.
- [x] Paste the generated image onto the tracked face naturally. (transgender network won't run in real time, 60fps）
- [ ] Translate gender of clothes.
## Usage
### Hololens demo
**Server**
```bash
# installation
make sample_transgender
cd transgender
sudo bash
source .anaconda3/bin/activate
./runserver.py
# client sample
./sample_post.py
```
**Client (Hololens)**
Author: [@ban-masa](https://github.com/ban-masa)
Deploy https://github.com/ban-masa/HoloFaceSamples/tree/real-harem to Hololens.
*Please check the URL of server.*
### Convert faces to female
Author: [@wkentaro](https://github.com/wkentaro)
We use [StarGAN](https://github.com/yunjey/StarGAN) for transgender.
```bash
make sample_transgender # it translates gender of JSK lab members.
```
### Paste face to face
Author: [@wkentaro](https://github.com/wkentaro)
```bash
make sample_paste_face # it paste face to face.
```
## Shared data
- [All data](https://drive.google.com/open?id=1H8EkgFOWPfjuBbdn_w3cQhvdkZgLp7vo)
- [Proposal ppt](https://drive.google.com/open?id=1H8NVqHPfGqQhsGrGBs5R1TFWZF2E-VRV)
- [Rinko (Survey) ppt](https://drive.google.com/open?id=1c0P3DTVWtyem8r3Z6t-XENbdEOkhSJTk)
- [Final demo ppt](https://drive.google.com/open?id=141NIbCRpNpCgqckLlYkeq5hXzsmcRZqx)