Exploring collaborative decision-making: A quasi-experimental study of human and Generative AI interaction
Исследование совместного принятия решений: квазиэкспериментальное исследование взаимодействия человека и генеративного ИИ
2024-07-17
SCID: 54.1/b9kzhd36
Discuss with AI
Generative Artificial Intelligence (GAI)Human-Generative AI collaborationSystem 1 and System 2 reasoningheuristic bias mitigationquasi-experimental pretest-posttest design
Figures from the paper
Abstract (AI)
This paper explores the effects of integrating Generative Artificial Intelligence (GAI) into decision-making processes within organizations, employing a quasi-experimental pretest-posttest design. The study examines the synergistic interaction between Human Intelligence (HI) and GAI across four group decision-making scenarios within three global organizations renowned for their cutting-edge operational techniques. The research progresses through several phases: identifying research problems, collecting baseline data on decision-making, implementing AI interventions, and evaluating the outcomes post-intervention to identify shifts in performance. The results demonstrate that GAI effectively reduces human cognitive burdens and mitigates heuristic biases by offering data-driven support and predictive analytics, grounded in System 2 reasoning. This is particularly valuable in complex situations characterized by unfamiliarity and information overload, where intuitive, System 1 thinking is less effective. However, the study also uncovers challenges related to GAI integration, such as potential over-reliance on technology, intrinsic biases particularly ‘out-of-the-box’ thinking without contextual creativity. To address these issues, this paper proposes an innovative strategic framework for HI-GAI collaboration that emphasizes transparency, accountability, and inclusiveness.
Key Findings
1
A quasi-experimental pretest-posttest study examined Human Intelligence (HI) and Generative AI (GAI) collaboration across four group decision-making scenarios in three global organizations.
2
GAI mitigated heuristic biases in decision-making, particularly helpful in complex, unfamiliar, or information-overloaded situations where intuitive System 1 thinking is less effective.
3
GAI reduced human cognitive burdens by providing data-driven support and predictive analytics, thereby supporting System 2 reasoning.
4
Integration challenges include potential over-reliance on GAI and intrinsic biases in AI outputs, such as ‘out-of-the-box’ thinking lacking contextual creativity.
5
The paper proposes a strategic HI-GAI collaboration framework emphasizing transparency, accountability, and inclusiveness to address integration challenges.
Research Object
Human–Generative AI collaborative decision-making in organizational group decision processes
Research Subject
Effects of integrating Generative AI on decision-making performance: reduction of cognitive burden and heuristic biases, shifts in System 1/System 2 reasoning, risks of over-reliance and intrinsic biases, and evaluation of a strategic framework emphasizing transparency, accountability, and inclusiveness
Publication Details
Publication Date
2024-07-17
Journal
Publisher
ISSN
Cited by
143
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai4
Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy2023
Artificial Intelligence and Management: The Automation–Augmentation Paradox2021
War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education2023
Heuristic Decision Making2010