Deepfake: Definitions, Performance Metrics And Standards, Datasets And Benchmarks, And A Meta-review

Abstract

Recent advancements in AI, especially deep learning, have contributed to a significant increase in the creation of new realistic-looking synthetic media (video, image, and audio) and manipulation of existing media, which has led to the creation of the new term ``deepfake''. Based on both the research literature and resources in English and in Chinese, this paper gives a comprehensive overview of deepfake, covering multiple important aspects of this emerging concept, including 1) different definitions, 2) commonly used performance metrics and standards, and 3) deepfake-related datasets, challenges, competitions and benchmarks. In addition, the paper also reports a meta-review of 12 selected deepfake-related survey papers published in 2020 and 2021, focusing not only on the mentioned aspects, but also on the analysis of key challenges and recommendations. We believe that this paper is the most comprehensive review of deepfake in terms of aspects covered, and the first one covering both t

Stats

• citations37
• S2 citations—
• github stars0
• HF likes0
• heat score11.85
• arxiv keyaltuncu2022deepfake

Related papers

• A Survey On Speech Deepfake Detection (2024)12.10
• Towards Robust Audio Deepfake Detection: A Evolving Benchmark For Continual Learning (2024)0.00
• Adversarial Attacks On Audio Deepfake Detection: A Benchmark And Comparative Study (2025)0.00
• Diffuse Or Confuse: A Diffusion Deepfake Speech Dataset (2024)5.24
• AUDETER: A Large-scale Dataset For Deepfake Audio Detection In Open Worlds (2025)0.00
• MFAAN: Unveiling Audio Deepfakes With A Multi-feature Authenticity Network (2023)7.81
• Xmad-bench: Cross-domain Multilingual Audio Deepfake Benchmark (2025)1.69
• Investigating Self-supervised Representations For Audio-visual Deepfake Detection (2025)0.00