Exploring collaborative decision-making: A quasi-experimental study of human and Generative AI interaction

Исследование совместного принятия решений: квазиэкспериментальное исследование взаимодействия человека и генеративного ИИ
Xinyue Hao, Emrah Demir, Daniel Eyers
2024-07-17

Generative Artificial Intelligence (GAI)Human-Generative AI collaborationSystem 1 and System 2 reasoningheuristic bias mitigationquasi-experimental pretest-posttest design
This paper explores the effects of integrating Generative Artificial Intelligence (GAI) into decision-making processes within organizations, employing a quasi-experimental pretest-posttest design. The study examines the synergistic interaction between Human Intelligence (HI) and GAI across four group decision-making scenarios within three global organizations renowned for their cutting-edge operational techniques. The research progresses through several phases: identifying research problems, collecting baseline data on decision-making, implementing AI interventions, and evaluating the outcomes post-intervention to identify shifts in performance. The results demonstrate that GAI effectively reduces human cognitive burdens and mitigates heuristic biases by offering data-driven support and predictive analytics, grounded in System 2 reasoning. This is particularly valuable in complex situations characterized by unfamiliarity and information overload, where intuitive, System 1 thinking is less effective. However, the study also uncovers challenges related to GAI integration, such as potential over-reliance on technology, intrinsic biases particularly ‘out-of-the-box’ thinking without contextual creativity. To address these issues, this paper proposes an innovative strategic framework for HI-GAI collaboration that emphasizes transparency, accountability, and inclusiveness.
1
A quasi-experimental pretest-posttest study examined Human Intelligence (HI) and Generative AI (GAI) collaboration across four group decision-making scenarios in three global organizations.
2
GAI mitigated heuristic biases in decision-making, particularly helpful in complex, unfamiliar, or information-overloaded situations where intuitive System 1 thinking is less effective.
3
GAI reduced human cognitive burdens by providing data-driven support and predictive analytics, thereby supporting System 2 reasoning.
4
Integration challenges include potential over-reliance on GAI and intrinsic biases in AI outputs, such as ‘out-of-the-box’ thinking lacking contextual creativity.
5
The paper proposes a strategic HI-GAI collaboration framework emphasizing transparency, accountability, and inclusiveness to address integration challenges.

Human–Generative AI collaborative decision-making in organizational group decision processes

Effects of integrating Generative AI on decision-making performance: reduction of cognitive burden and heuristic biases, shifts in System 1/System 2 reasoning, risks of over-reliance and intrinsic biases, and evaluation of a strategic framework emphasizing transparency, accountability, and inclusiveness

Publication Details
Publication Date
2024-07-17
Journal
Publisher
ISSN
Cited by
143
Access Type
Author Information
Authors
Xinyue Hao
Emrah Demir
Daniel Eyers
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%