https://github.com/tismoney/faceswapping

Project of Skoltech course "Introduction to Computer Vision"
https://github.com/tismoney/faceswapping

cv2 face-detection face-swapping haar-cascade keypoint-detection opencv-python

Last synced: 8 months ago
JSON representation

Project of Skoltech course "Introduction to Computer Vision"

• Host: GitHub
• URL: https://github.com/tismoney/faceswapping
• Owner: Tismoney
• Created: 2019-12-08T14:36:05.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2019-12-28T21:53:16.000Z (over 6 years ago)
• Last Synced: 2025-05-06T01:40:07.667Z (about 1 year ago)
• Topics: cv2, face-detection, face-swapping, haar-cascade, keypoint-detection, opencv-python
• Language: Jupyter Notebook
• Homepage:
• Size: 23 MB
• Stars: 19
• Watchers: 2
• Forks: 4
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Fase Swapping

## Step-by-step solution

Based on this [solution](https://pysource.com/2019/05/28/face-swapping-explained-in-8-steps-opencv-with-python/).

### 1. Face detection

![step_1](./imgs/step_1.png)

### 2. Keypoints detection

![step_2](./imgs/step_2.png)

### 3. Face cropping

![step_3](./imgs/step_3.png)

### 4. Face triangulation

![step_4](./imgs/step_4.png)

### 5. Reconstruction new face

![step_5_idea](./imgs/step_5.png)

![step_5_gif](./imgs/step_5.gif)

### 6. Pull up new face

![step_5_end](./imgs/step_6.png)

### 6. Seamless Cloning

![step_5_end](./imgs/step_7.png)

## Examples

![ex1](./imgs/result_two.png)

## Techology part

The most of the algorithms are written using [openCV](https://pypi.org/project/opencv-python/)

* Face detection: **Haar Cascade**

* Keypoint detection: **The cascade of regressors** using [dlib](http://dlib.net) based on this [paper](http://www.nada.kth.se/~sullivan/Papers/Kazemi_cvpr14.pdf)

* Face triangulation: simple **Triangulation**

* Reconstruction: **Affine projection** each triangles 

* Color alignment: **Seamless Cloning** ([details](http://amroamroamro.github.io/mexopencv/opencv/cloning_demo.html))