Replicability, Robustness, and Reproducibility in Psychological Science
Воспроизводимость, устойчивость и репродуцируемость в психологической науке
2021-10-19
SCID: 54.1/zjdcxw53
Discuss with AI
multi-site replicationpsychological sciencereplicabilityreproducibilityrobustness
Figures from the paper
Abstract (AI)
Replication-an important, uncommon, and misunderstood practice-is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress.
Key Findings
1
Advances in replication, reproducibility, and robustness have increased psychology’s capacity for scientific self-correction and improved research practices.
2
Replication functions as a productive process for generating and testing hypotheses by exposing weaknesses in prevailing understandings and stimulating innovation.
3
Replication is essential for psychological progress because nonreplicable findings impede prediction and theory development, whereas replicable findings enable deeper evaluation of meaning and validity.
4
Systematic and multi-site replication projects in psychology revealed unexpected failures to replicate numerous published findings during the 2010s.
5
The replication movement identified sociocultural barriers, including weak incentives for conducting replications and perceptions of replication as a personal attack.
Research Object
psychological science research findings and practices
Research Subject
replicability, robustness, reproducibility, and their role in scientific self-correction and research progress
Publication Details
Publication Date
2021-10-19
Journal
Publisher
ISSN
Cited by
794
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest