Where the earth is flat and 9/11 is an inside job: A comparative algorithm audit of conspiratorial information in web search results

Где Земля плоская, а теракты 11 сентября — дело рук самой системы: сравнительный алгоритмический аудит конспирологической информации в результатах веб-поиска
Aleksandra Urman, Mykola Makhortykh, Roberto Ulloa, Juhi Kulshrestha
2022-07-06

algorithm auditconspiracy theoriessearch resultsvirtual agent-based infrastructureweb search engines
Web search engines are important online information intermediaries that are frequently used and highly trusted by the public despite multiple evidence of their outputs being subjected to inaccuracies and biases. One form of such inaccuracy, which so far received little scholarly attention, is the presence of conspiratorial information, namely pages promoting conspiracy theories. We address this gap by conducting a comparative algorithm audit to examine the distribution of conspiratorial information in search results across five search engines: Google, Bing, DuckDuckGo, Yahoo and Yandex. Using a virtual agent-based infrastructure, we systematically collect search outputs for six conspiracy theory-related queries (“flat earth”, “new world order”, “qanon”, “9/11”, “illuminati”, “george soros”) across three locations (two in the US and one in the UK) and two waves (March and May 2021). We find that all search engines except Google consistently displayed conspiracy-promoting results and returned links to conspiracy-dedicated websites, with variations across queries. Most conspiracy-promoting results came from social media and conspiracy-dedicated websites while conspiracy-debunking information was shared by scientific websites and legacy media. These observations are consistent across different locations and time periods highlighting the possibility that some engines systematically prioritize conspiracy-promoting content.
1
All engines except Google consistently displayed conspiracy-promoting results and links to conspiracy-dedicated websites, varying by query.
2
Conspiracy-promoting results mainly originated from social media and conspiracy-focused websites, whereas debunking content came from scientific sites and legacy media.
3
Patterns remained consistent across three locations and two collection waves, suggesting some search engines may systematically prioritize conspiracy-promoting content.
4
The study audits conspiratorial information in search results across Google, Bing, DuckDuckGo, Yahoo, and Yandex.

Conspiratorial information in web search results across five search engines

The distribution, sources, and cross-engine, geographic, and temporal variation of conspiracy-promoting and conspiracy-debunking results, including systematic prioritization of conspiracy-promoting content

Publication Details
Publication Date
2022-07-06
Journal
Publisher
ISSN
Cited by
48
Access Type
Author Information
Authors
Aleksandra Urman
Mykola Makhortykh
Roberto Ulloa
Juhi Kulshrestha
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%