Why Hypothesis Testers Should Spend Less Time Testing Hypotheses
Почему исследователям, проверяющим гипотезы, следует тратить меньше времени на их проверку
2020-12-16
SCID: 54.1/vy37khq7
Discuss with AI
derivation chainhypothesis testingnonconfirmatory researchnull-hypothesis significance testingreplication crisis
Figures from the paper
Abstract (AI)
For almost half a century, Paul Meehl educated psychologists about how the mindless use of null-hypothesis significance tests made research on theories in the social sciences basically uninterpretable. In response to the replication crisis, reforms in psychology have focused on formalizing procedures for testing hypotheses. These reforms were necessary and influential. However, as an unexpected consequence, psychological scientists have begun to realize that they may not be ready to test hypotheses. Forcing researchers to prematurely test hypotheses before they have established a sound "derivation chain" between test and theory is counterproductive. Instead, various nonconfirmatory research activities should be used to obtain the inputs necessary to make hypothesis tests informative. Before testing hypotheses, researchers should spend more time forming concepts, developing valid measures, establishing the causal relationships between concepts and the functional form of those relationships, and identifying boundary conditions and auxiliary assumptions. Providing these inputs should be recognized and incentivized as a crucial goal in itself. In this article, we discuss how shifting the focus to nonconfirmatory research can tie together many loose ends of psychology's reform movement and help us to develop strong, testable theories, as Paul Meehl urged.
Key Findings
1
Developing these inputs should be treated and incentivized as a crucial research goal, enabling stronger and more informative theory tests.
2
Nonconfirmatory research should establish clear concepts, valid measurements, causal relationships, functional forms, boundary conditions, and auxiliary assumptions before confirmatory testing.
3
Premature hypothesis testing without a sound derivation chain between theory and test can make psychological research uninterpretable and counterproductive.
4
Prioritizing nonconfirmatory work can integrate psychology’s reform efforts and support the development of strong, testable theories, as advocated by Paul Meehl.
5
Psychology’s replication reforms appropriately formalized hypothesis-testing procedures but may have inadvertently encouraged testing before theories and measures are sufficiently developed.
Research Object
psychological theories and their hypothesis-testing derivation chains in social-science research
Research Subject
the development of sound, informative hypothesis tests through concept formation, valid measurement, causal-relationship and functional-form specification, and identification of boundary conditions and auxiliary assumptions
Publication Details
Publication Date
2020-12-16
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest