Validation Guidelines for IS Positivist Research
Рекомендации по валидации позитивистских исследований в области информационных систем
2004-01-01
SCID: 54.1/hc46cw94
Discuss with AI
IS positivist researchconstruct validityinstrument validationreliabilitystatistical conclusion validity
Figures from the paper
Abstract (AI)
The issue of whether IS positivist researchers were sufficiently validating their instruments was initially raised fifteen years ago and rigor in IS research is still one of the most critical scientific issues facing the field. Without solid validation of the instruments that are used to gather data on which findings and interpretations are based, the very scientific basis of the profession is threatened. This study builds on four prior retrospectives of IS research that conclude that IS positivist researchers continue to face major barriers in instrument, statistical, and other forms of validation. It goes beyond these studies by offering analyses of the state-of-the-art of research validities and deriving specific heuristics for research practice in the validities. Some of these heuristics will, no doubt, be controversial. But we believe that it is time for the IS academic profession to bring such issues into the open for community debate. This article is a first step in that direction. Based on our interpretation of the importance of a long list of validities, this paper suggests heuristics for reinvigorating the quest for validation in IS research via content/construct validity, reliability, manipulation validity, and statistical conclusion validity. New guidelines for validation and new research directions are offered.
Key Findings
1
IS positivist researchers continue to face major barriers in validating instruments, statistical analyses, and other aspects of research validity.
2
Insufficient instrument validation threatens the scientific foundation of Information Systems research because findings depend on the quality of collected data.
3
It proposes heuristics addressing content and construct validity, reliability, manipulation validity, and statistical conclusion validity.
4
The paper offers new validation guidelines and research directions while acknowledging that some recommendations may be controversial and require community debate.
5
The study synthesizes prior retrospectives and analyzes the state of research validities to derive specific, practice-oriented validation heuristics.
Research Object
Instrument validation practices in positivist Information Systems (IS) research
Research Subject
The state of research validity and guidelines for validating instruments, measurements, manipulations, and statistical conclusions
Publication Details
Publication Date
2004-01-01
Journal
Publisher
ISSN
Cited by
2841
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai4
Common method biases in behavioral research: A critical review of the literature and recommended remedies.2003
Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology1989
Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation1991
Understanding Information Technology Usage: A Test of Competing Models1995
Cited by3
Exploring the relationship between big data analytics capability and competitive performance: The mediating roles of dynamic and operational capabilities2019
The effects of a gamified human resource management system on job satisfaction and engagement2020
Determining factors in shaping the sustainable behavior of the generation Z consumer2023