/ Machine Learning

Learning to Detect Manipulated Facial Images

Learning to Detect Manipulated Facial Images

FaceForensics

FaceForensics++ is a forensics dataset consisting of 1000 original video sequences that have been manipulated with four automated face manipulation methods: Deepfakes, Face2Face, FaceSwap and NeuralTextures. The data has been sourced from 977 youtube videos and all videos contain a trackable mostly frontal face without occlusions which enables automated tampering methods to generate realistic forgeries. As we provide binary masks the data can be used for image and video classification as well as segmentation. In addition, we provide 1000 Deepfakes models to generate and augment new data.

For more information, please consult our updated paper.

What is new

DDD_samples

  • Deep Fake Detection Dataset: We are hosting the Deep Fake Detection Dataset provided by Google & JigSaw. The dataset contains over 3000 manipulated videos from 28 actors in various scenes. The dataset has a similar file structure and is downloaded by default together with the regular dataset. See the dataset page for more information.

  • Neural Textures: We included a fourth manipulation method that does face manipulation using GANs and Neural Textures. All results have been updated to incorporate the new manipulation method and we have updated the benchmark as well. We refer to the paper for more information.
    Unfortunately, we won't continue support on the old benchmark after this update, though you can still submit your models to the new benchmark by creating a new submission.

Access

If you would like to download the FaceForensics++ dataset, please fill out this google form and, once accepted, we will send you the link to our download script.

If you have not received a response within a week, it is likely that your email is bouncing - please check this before sending repeat requests.

Once, you obtain the download link, please head to the download section. You can also find details about the generation of the dataset there.

Benchmark

We are offering an automated benchmark for facial manipulation detection on the presence of compression based on our manipulation methods that contains 1000 images. If you are interested to test your approach on unseen data, check it out! For more information, please consult our paper. You can download the benchmark images here.

Original FaceForensics

You can view the original FaceForensics github here. Any request to this dataset will also contain the download link to the original version of our dataset.

Citation

If you use the FaceForensics++ data or code please cite:

@inproceedings{roessler2019faceforensicspp,
	author = {Andreas R\"ossler and Davide Cozzolino and Luisa Verdoliva and Christian Riess and Justus Thies and Matthias Nie{\ss}ner},
	title = {Face{F}orensics++: Learning to Detect Manipulated Facial Images},
	booktitle= {International Conference on Computer Vision (ICCV)},
	year = {2019}
}

GitHub