Combating misinformation in the age of LLMs: Opportunities and challenges
Борьба с дезинформацией в эпоху больших языковых моделей: возможности и вызовы
2024-08-01
SCID: 54.1/ajbtz7cz
Discuss with AI
LLM-generated misinformationfake newslarge language modelsmisinformation detectionrumor detection
Figures from the paper
Abstract (AI)
Abstract Misinformation such as fake news and rumors is a serious threat for information ecosystems and public trust. The emergence of large language models (LLMs) has great potential to reshape the landscape of combating misinformation. Generally, LLMs can be a double‐edged sword in the fight. On the one hand, LLMs bring promising opportunities for combating misinformation due to their profound world knowledge and strong reasoning abilities. Thus, one emerging question is: can we utilize LLMs to combat misinformation? On the other hand, the critical challenge is that LLMs can be easily leveraged to generate deceptive misinformation at scale. Then, another important question is: how to combat LLM‐generated misinformation? In this paper, we first systematically review the history of combating misinformation before the advent of LLMs. Then we illustrate the current efforts and present an outlook for these two fundamental questions, respectively. The goal of this survey paper is to facilitate the progress of utilizing LLMs for fighting misinformation and call for interdisciplinary efforts from different stakeholders for combating LLM‐generated misinformation.
Key Findings
1
Effective responses to LLM-generated misinformation require interdisciplinary collaboration among diverse stakeholders.
2
LLMs are a double-edged sword because they can also generate deceptive misinformation at scale.
3
LLMs offer promising opportunities to combat misinformation through their extensive world knowledge and strong reasoning abilities.
4
The paper identifies two central questions: how to use LLMs to combat misinformation and how to counter misinformation generated by LLMs.
5
The paper surveys the historical development of misinformation-combatting methods before LLMs and reviews current efforts involving LLMs.
Research Object
large language models (LLMs) in the misinformation ecosystem
Research Subject
opportunities and challenges of using LLMs to detect and combat misinformation, including LLM-generated deceptive content
Publication Details
Publication Date
2024-08-01
Journal
Publisher
ISSN
Cited by
282
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai17
A survey on large language model based autonomous agents2024
ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap2024
🧜Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models2025
Power to the People: The Role of Humans in Interactive Machine Learning2014
Active Retrieval Augmented Generation2023
Prompt Injection attack against LLM-integrated Applications2023
Connecting the dots in trustworthy Artificial Intelligence: From AI principles, ethics, and key requirements to responsible AI systems and regulation2023
Detection and Resolution of Rumours in Social Media2018
ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health2023
Not What You've Signed Up For: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection2023
Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy2023
Multimodal Foundation Models: From Specialists to General-Purpose Assistants2024
Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineering2023
Large Language Models and Knowledge Graphs: Opportunities and Challenges2023
Extractive Summarization via ChatGPT for Faithful Summary Generation2023
Qualitative Spatial Reasoning over Questions (Short Paper)2022