A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Обзор методов обнаружения дипфейков и их воздействия в визуальном, аудиальном и текстовом форматах
2023-01-01
SCID: 54.1/br3g524s
Discuss with AI
deepfake detectionlarge language modelsmisinformationmultimodal deepfakestext-based deepfakes
Figures from the paper
Abstract (AI)
In the rapidly evolving digital landscape, the generation of fake visual, audio, and textual content poses a significant threat to society’s trust, political stability, and integrity of information. The generation process has been enhanced and simplified using Artificial Intelligence techniques, which have been termeddeepfake. Although significant attention has been paid to visual and audio deepfakes, there is also a burgeoning need to consider text-based deepfakes. Due to advancements in natural language processing and large language models, the potential of manipulating textual content to reshape online discourse and misinformation has increased. This study comprehensively examines the multifaceted nature and impacts of deep-fake-generated media. This work explains the broad implications of deepfakes in social, political, economic, and technological domains. State-of-the-art detection methodologies for all types of deepfake are critically reviewed, highlighting the need for unified, real-time, adaptable, and generalised solutions. As the challenges posed by deepfakes intensify, this study underscores the importance of a holistic approach that intertwines technical solutions with public awareness and legislative action. By providing a comprehensive overview and establishing a framework for future exploration, this study seeks to assist researchers, policymakers, and practitioners in navigating the complexities of deepfake phenomena.
Key Findings
1
Addressing deepfakes requires integrating technical detection with public awareness and legislative action.
2
Deepfake-generated media can affect social trust, political stability, information integrity, and broader social, political, economic, and technological systems.
3
Deepfakes now encompass visual, audio, and increasingly textual content, enabled by advances in artificial intelligence, natural language processing, and large language models.
4
Existing detection methodologies across modalities require unified, real-time, adaptable, and generalizable solutions.
5
Text-based deepfakes pose a growing threat by enabling manipulation of online discourse and the spread of misinformation.
Research Object
AI-generated deepfake media in visual, audio, and textual formats
Research Subject
The detection methodologies and multifaceted societal, political, economic, and technological impacts of deepfakes
Publication Details
Publication Date
2023-01-01
Journal
Publisher
ISSN
Cited by
165
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai6
Deep Residual Learning for Image Recognition2016
Generative Adversarial Networks: An Overview2018
PaLM: Scaling Language Modeling with Pathways2022
Tacotron: Towards End-to-End Speech Synthesis2017
Deepfake Detection: A Systematic Literature Review2022
Qualitative Spatial Reasoning over Questions (Short Paper)2022