Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/JustinYuu/awesome-deepfakes

A curated list of awesome DeepFake papers, datasets, and codes.
https://github.com/JustinYuu/awesome-deepfakes

List: awesome-deepfakes

Last synced: 3 months ago
JSON representation

A curated list of awesome DeepFake papers, datasets, and codes.

Awesome Lists containing this project

README

        

# Awesome-DeepFakes [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/wasabeef/awesome-android-ui)
A curated list of awesome DeepFake papers, datasets, and codes.
*If there is any inconvenient information on this list, please contact us and we will delete it as soon as possible.*

## Contents
* [Papers](#Papers)
* [Datasets](#Datasets)
* [Codes](#Codes)

##

Papers


*Libraries for DeepFake public published or arXiv preprint papers.*

* Deepfake Survey&Reports
- “Deep Fakes” using Generative Adversarial Networks(GAN) (Report2016) [[paper]](http://noiselab.ucsd.edu/ECE228_2018/Reports/Report16.pdf)
- Deep Learning for Deepfakes Creation and Detection (arXiv Preprint 2019.9) [[paper]](https://arxiv.org/pdf/1909.11573.pdf)
- DeepFakes a new threat to face recognition assessment and detection (arXiv Preprint 2018.12) [[paper]](https://arxiv.org/pdf/1812.08685.pdf)

* Deepfake Creation
- Face2Face: Real-time Face Capture and Reenactment of RGB Videos (CVPR2016) [[paper]](https://ieeexplore.ieee.org/document/7780631)
- Fast Face-swap Using Convolutional Neural Networks (ICCV2017) [[paper]](https://biblio.ugent.be/publication/8536140/file/8539082.pdf)
- Synthesizing Obama Learning Lip Sync from Audio (TOG2017) [[paper]](https://grail.cs.washington.edu/projects/AudioToObama/siggraph17_obama.pdf)
- Text-based Editing of Talking-head Video (SIGGRAPH2019) [[paper]](https://www.ohadf.com/projects/text-based-editing/data/text-based-editing.pdf)
- FSGAN Subject Agnostic Face Swapping and Reenactment (ICCV2019) [[paper]](https://arxiv.org/pdf/1908.05932.pdf)
- Deferred Neural Rendering: Image Synthesis using Neural Textures(arXiv preprint 2019.4) [[paper]](https://arxiv.org/pdf/1904.12356.pdf) [[website]](https://niessnerlab.org/projects/thies2019neural.html)

* Deepfake Detection
- Two-Stream Neural Networks for Tampered Face Detection (CVPRW2017) [[paper]](https://arxiv.org/pdf/1803.11276.pdf)
- Capsule-forensics Using capsule networks to detect forged images and videos (ICASSP2019) [[paper]](https://arxiv.org/pdf/1810.11215.pdf)
- Combating Deepfake Videos Using Blockchain and Smart Contracts (IEEE Access2019) [[paper]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8668407)
- Deepfake Video Detection Using Recurrent Neural Networks (AVSS2018) [[paper]](https://engineering.purdue.edu/~dgueraco/content/deepfake.pdf)
- Detection of Deepfake Video Manipulation (IMVIP 2018) [[paper]](https://arxiv.org/pdf/1909.11573.pdf)
- Detection of GAN-generated Fake Images over Social Networks (MIPR2018) [[paper]](https://ieeexplore.ieee.org/document/8397040)
- Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations (CVPRW2019) [[paper]](https://faui1-files.cs.fau.de/public/publications/mmsec/2019-Matern-EVA.pdf)
- Exposing Deep Fakes Using Inconsistent Head Poses (ICASSP2019) [[paper]](https://arxiv.org/pdf/1811.00661.pdf)
- Exposing DeepFake Videos By Detecting Face Warping Artifacts (CVPRW2019) [[paper]](https://arxiv.org/pdf/1811.00656.pdf)
- Exposing GAN-synthesized Faces Using Landmark Locations (arXiv preprint 2019.3) [[paper]](https://arxiv.org/pdf/1904.00167.pdf)
- In Ictu Oculi Exposing AI Generated Fake Face Videos by Detecting Eye Blinking (WIFS2018) [[paper]](https://arxiv.org/pdf/1806.02877.pdf)
- MesoNet a Compact Facial Video Forgery Detection Network (WIFS2018) [[paper]](https://arxiv.org/pdf/1809.00888.pdf)
- Protecting World Leaders Against Deep Fakes (CVPRW 2019) [[paper]](http://openaccess.thecvf.com/content_CVPRW_2019/papers/Media%20Forensics/Agarwal_Protecting_World_Leaders_Against_Deep_Fakes_CVPRW_2019_paper.pdf)
- Recurrent Convolutional Strategies for Face Manipulation Detection in Videos (CVPRW2019) [[paper]](https://arxiv.org/abs/1905.00582)
- Speaker inconsistency detection in tampered video (EUSIPCO2018) [[paper]](https://www.eurasip.org/Proceedings/Eusipco/Eusipco2018/papers/1570439304.pdf)
- Vulnerability of Face Recognition to Deep Morphing (arXiv preprint 2019.10)[[paper]](https://arxiv.org/pdf/1910.01933.pdf)
- Limits of Deepfake Detection: A Robust Estimation Viewpoint(arXiv preprint 2019.5)[[paper]](https://arxiv.org/pdf/1905.03493.pdf)
- Detecting GAN generated Fake Images using Co-occurrence Matrices(arXiv preprint 2019.10)[[paper]](https://arxiv.org/pdf/1903.06836.pdf)
- Detecting GAN-generated Imagery using Color Cues(arXiv preprint 2018.12)[[paper]](https://arxiv.org/pdf/1812.08247.pdf)

##

Datasets


*Libraries for DeepFake dataset.*

- UADFV: Exposing Deep Fakes Using Inconsistent Head Poses (ICASSP2019) [[paper]](https://arxiv.org/pdf/1811.00661.pdf)
- DF-TIMIT-LQ/DF-TIMIT-HQ: DeepFakes a new threat to face recognition assessment and detection (arXiv Preprint 2018.12) [[paper]](https://arxiv.org/pdf/1812.08685.pdf) [[website]](https://www.idiap.ch/dataset/deepfaketimit)
- FaceForensics: Face Forensics: A Large-scale Video Dataset for Forgery Detection in Human Faces (arXiv preprint 2018.3) [[paper]](https://arxiv.org/pdf/1803.09179.pdf) [[github]](https://github.com/ondyari/FaceForensics)
- FaceForensics++: FaceForensics++: Learning to Detect Manipulated Facial Images (arXiv preprint 2019.3) [[paper]](https://arxiv.org/pdf/1901.08971.pdf) [[github]](https://github.com/ondyari/FaceForensics)
- DFD: Deepfakes detection dataset by google & jigsaw(released in FaceForensics++ dataset) [[github]](https://github.com/DataScienceNigeria/Fake-Detection-dataset-for-deepfake-from-Google-and-Jigsaw)
- DFDC Preview: The Deepfake Detection Challenge(DFDC) Preview Dataset (arXiv preprint 2019.10) [[paper]](https://arxiv.org/pdf/1910.08854.pdf) [[website]](https://deepfakedetectionchallenge.ai/)
- Celeb-DF: Celeb-DF: A New Dataset for DeepFake Forensics (arXiv preprint 2019.11.27) [[paper]](https://arxiv.org/pdf/1909.12962v3.pdf) [github](https://github.com/danmohaha/celeb-deepfakeforensics)

##

Codes


*Libraries for DeepFakes creation and DeepFakes detection codes.*

#### DeepFakes Creation Method
Faceswap [[github]](https://github.com/deepfakes/faceswap)
GAN-based Faceswap [[github]](https://github.com/shaoanlu/faceswap-GAN)
Fewshot face translation GAN [[github]](https://github.com/shaoanlu/fewshot-face-translation-GAN)

#### DeepFakes Detection Method
MesoNet [[github]](https://github.com/DariusAf/MesoNet)
HeadPose Forensic [[bitbucket]](https://bitbucket.org/ericyang3721/headpose_forensic/src/master/)
Face Warping Artifacts(FWA) [[github]](https://github.com/danmohaha/CVPRW2019_Face_Artifacts)
Exploiting Visual Artifacts [[github]](https://github.com/FalkoMatern/Exploiting-Visual-Artifacts)
Xception [[github]](https://github.com/ondyari/FaceForensics)
Multi-task [[github]](https://github.com/nii-yamagishilab/ClassNSeg)
Capsule Forensics [[github]](https://github.com/nii-yamagishilab/Capsule-Forensics-v2)
DSP-FWA [[github]](https://github.com/danmohaha/DSP-FWA)

-------

Any contributing is welcomed!