Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/alyssaq/face_morpher

:angel: Morph faces with Python, Numpy, Scipy
https://github.com/alyssaq/face_morpher

numpy opencv python python3

Last synced: about 21 hours ago
JSON representation

:angel: Morph faces with Python, Numpy, Scipy

Awesome Lists containing this project

README

        

Face Morpher
============

| Warp, average and morph human faces!
| Scripts will automatically detect frontal faces and skip images if
none is detected.

Built with Python, `dlib`_, Numpy, Scipy, dlib.

| Supported on Python 2.7, Python 3.6+
| Tested on macOS Mojave and 64bit Linux (dockerized).

Requirements
--------------
- ``pip install -r requirements.txt``
- Download `http://dlib.net/files/shape_predictor_68_face_landmarks.dat.bz2` and extract file.
- Export environment variable ``DLIB_DATA_DIR`` to the folder where ``shape_predictor_68_face_landmarks.dat`` is located. Default ``data``. E.g ``export DLIB_DATA_DIR=/Downloads/data``

Either:

- `Use as local command-line utility`_
- `Use as pip library`_
- `Try out in a docker container`_

.. _`Use as local command-line utility`:

Use as local command-line utility
---------------------------------
::

$ git clone https://github.com/alyssaq/face_morpher

Morphing Faces
--------------

Morph from a source to destination image:

::

python facemorpher/morpher.py --src= --dest= --plot

Morph through a series of images in a folder:

::

python facemorpher/morpher.py --images= --out_video=out.avi

All options listed in ``morpher.py`` (pasted below):

::

Morph from source to destination face or
Morph through all images in a folder

Usage:
morpher.py (--src= --dest= | --images=)
[--width=] [--height=]
[--num=] [--fps=]
[--out_frames=] [--out_video=]
[--plot] [--background=(black|transparent|average)]

Options:
-h, --help Show this screen.
--src= Filepath to source image (.jpg, .jpeg, .png)
--dest= Filepath to destination image (.jpg, .jpeg, .png)
--images= Folderpath to images
--width= Custom width of the images/video [default: 500]
--height= Custom height of the images/video [default: 600]
--num= Number of morph frames [default: 20]
--fps= Number frames per second for the video [default: 10]
--out_frames= Folder path to save all image frames
--out_video= Filename to save a video
--plot Flag to plot images to result.png [default: False]
--background= Background of images to be one of (black|transparent|average) [default: black]
--version Show version.

Averaging Faces
---------------

Average faces from all images in a folder:

::

python facemorpher/averager.py --images= --out=average.png

All options listed in ``averager.py`` (pasted below):

::

Face averager

Usage:
averager.py --images= [--blur] [--plot]
[--background=(black|transparent|average)]
[--width=] [--height=]
[--out=] [--destimg=]

Options:
-h, --help Show this screen.
--images= Folder to images (.jpg, .jpeg, .png)
--blur Flag to blur edges of image [default: False]
--width= Custom width of the images/video [default: 500]
--height= Custom height of the images/video [default: 600]
--out= Filename to save the average face [default: result.png]
--destimg= Destination face image to overlay average face
--plot Flag to display the average face [default: False]
--background= Background of image to be one of (black|transparent|average) [default: black]
--version Show version.

Steps (facemorpher folder)
--------------------------

1. Locator
^^^^^^^^^^

- Locates face points
- For a different locator, return an array of (x, y) control face
points

2. Aligner
^^^^^^^^^^

- Align faces by resizing, centering and cropping to given size

3. Warper
^^^^^^^^^

- Given 2 images and its face points, warp one image to the other
- Triangulates face points
- Affine transforms each triangle with bilinear interpolation

4a. Morpher
^^^^^^^^^^^

- Morph between 2 or more images

4b. Averager
^^^^^^^^^^^^

- Average faces from 2 or more images

Blender
^^^^^^^

Optional blending of warped image:

- Weighted average
- Alpha feathering
- Poisson blend

Examples - `Being John Malkovich`_
----------------------------------

Create a morphing video between the 2 images:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

| ``> python facemorpher/morpher.py --src=alyssa.jpg --dest=john_malkovich.jpg``
| ``--out_video=out.avi``

(out.avi played and recorded as gif)

.. figure:: https://raw.github.com/alyssaq/face_morpher/master/examples/being_john_malvokich.gif
:alt: gif

Save the frames to a folder:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^

| ``> python facemorpher/morpher.py --src=alyssa.jpg --dest=john_malkovich.jpg``
| ``--out_frames=out_folder --num=30``

Plot the frames:
^^^^^^^^^^^^^^^^

| ``> python facemorpher/morpher.py --src=alyssa.jpg --dest=john_malkovich.jpg``
| ``--num=12 --plot``

.. figure:: https://raw.github.com/alyssaq/face_morpher/master/examples/plot.png
:alt: plot

Average all face images in a folder:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

85 images used

| ``> python facemorpher/averager.py --images=images --blur --background=transparent``
| ``--width=220 --height=250``

.. figure:: https://raw.github.com/alyssaq/face_morpher/master/examples/average_faces.png
:alt: average\_faces

.. _`Use as pip library`:

Use as pip library
---------------------------------
::

$ pip install facemorpher

Examples
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Additional options are exactly the same as the command line

::

import facemorpher

# Get a list of image paths in a folder
imgpaths = facemorpher.list_imgpaths('imagefolder')

# To morph, supply an array of face images:
facemorpher.morpher(imgpaths, plot=True)

# To average, supply an array of face images:
facemorpher.averager(['image1.png', 'image2.png'], plot=True)

Once pip installed, 2 binaries are also available as a command line utility:

::

$ facemorpher --src= --dest= --plot
$ faceaverager --images= --plot

Try out in a docker container
---------------------------------
Mount local folder to `/images` in docker container, run it and enter a bash session.
--rm removes the container when you close it.
::

$ docker run -v /Users/alyssa/Desktop/images:/images --name py3 --rm -it jjanzic/docker-python3-opencv bash

Once you're in the container, install ``facemorpher`` and try the examples listed above
::

root@0dad0912ebbe:/# pip install facemorpher
root@0dad0912ebbe:/# facemorpher --src= --dest= --plot

Documentation
-------------

http://alyssaq.github.io/face_morpher

Build & publish Docs
^^^^^^^^^^^^^^^^^^^^

::

./scripts/publish_ghpages.sh

License
-------
`MIT`_

.. _Being John Malkovich: http://www.rottentomatoes.com/m/being_john_malkovich
.. _Mac installation steps: https://gist.github.com/alyssaq/f60393545173379e0f3f#file-4-opencv3-with-python3-md
.. _MIT: http://alyssaq.github.io/mit-license
.. _OpenCV: http://opencv.org
.. _Homebrew: https://brew.sh
.. _source: https://github.com/opencv/opencv
.. _dlib: http://dlib.net