Replicability, Robustness, and Reproducibility in Psychological Science

Воспроизводимость, устойчивость и репродуцируемость в психологической науке
Tom Elis Hardwicke, Brian A. Nosek, Julia M. Rohrer, Simine Vazire, Fiona M. Fidler, Anna Dreber, Melissa Kline Struhl, Anne M. Scheel, Aurélien Allard, Felipe Romero, Felix D. Schönbrodt, Katherine S. Corker, Hannah Moshontz, Laura Danielle Scherer, Michèle B. Nuijten, Joe Hilgard
2021-10-19

multi-site replicationpsychological sciencereplicabilityreproducibilityrobustness
Replication-an important, uncommon, and misunderstood practice-is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress.
1
Advances in replication, reproducibility, and robustness have increased psychology’s capacity for scientific self-correction and improved research practices.
2
Replication functions as a productive process for generating and testing hypotheses by exposing weaknesses in prevailing understandings and stimulating innovation.
3
Replication is essential for psychological progress because nonreplicable findings impede prediction and theory development, whereas replicable findings enable deeper evaluation of meaning and validity.
4
Systematic and multi-site replication projects in psychology revealed unexpected failures to replicate numerous published findings during the 2010s.
5
The replication movement identified sociocultural barriers, including weak incentives for conducting replications and perceptions of replication as a personal attack.

psychological science research findings and practices

replicability, robustness, reproducibility, and their role in scientific self-correction and research progress

Publication Details
Publication Date
2021-10-19
Journal
Publisher
ISSN
Cited by
794
Access Type
Author Information
Authors
Tom Elis Hardwicke
Brian A. Nosek
Julia M. Rohrer
Simine Vazire
Fiona M. Fidler
Anna Dreber
Melissa Kline Struhl
Anne M. Scheel
Aurélien Allard
Felipe Romero
Felix D. Schönbrodt
Katherine S. Corker
Hannah Moshontz
Laura Danielle Scherer
Michèle B. Nuijten
Joe Hilgard
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%