Morality Meets Machine: How Evaluator and Agent Gender Shape Human-AI Moral Judgment

Мораль и машина: как пол оценщиков и агентов формирует моральные суждения о взаимодействии человека и ИИ
Yue He, Guangzhi Deng, Chao Liu, Tian Gan, Fang Cui, Yi Luo, Ruolei Gu
2026-06-14

AI agent genderAI misconductAI moral judgmentevaluator genderhuman-computer interaction
As gendered AI agents are increasingly integrated into social domains, how users morally evaluate their misconduct and whether such judgments vary by gender remains underexplored. This series of studies explores how the gender of evaluators, AI agents, and patients influences moral evaluations of AI across multiple domains. Male participants tended to show greater leniency toward AI misconduct, often attributing it to technical issues in ways that may align with physical or design perspectives. Female participants exhibited a domain-sensitive pattern, showing more leniency in individualizing domains (fairness, liberty, purity) while applying more human-like moral standards in binding domains (harm, betrayal, subversion), potentially reflecting an intentional stance. Their explanations also contained richer emotional and relational language. Additionally, male evaluators seemed to project gender role expectations onto opposite-gender AI agents, judging feminized AI more harshly when harming female patients. These findings offer important implications for more equitable and effective human-computer interaction design.
1
Female evaluators used richer emotional and relational language when explaining their moral judgments of AI behavior.
2
Female participants showed domain-sensitive moral evaluations: greater leniency in individualizing domains but more human-like standards in binding domains.
3
Male evaluators appeared to project gender-role expectations onto opposite-gender AI agents, judging feminized agents more harshly when they harmed female patients.
4
Male participants generally judged AI misconduct more leniently, often attributing violations to technical problems or design-related causes.
5
The findings indicate that evaluator, agent, and patient gender jointly shape moral judgments of AI and should inform equitable human-AI interaction design.

Gendered AI agents and human evaluators making moral judgments about AI misconduct across moral domains and patient genders

The effects of evaluator, AI-agent, and patient gender on the leniency, standards, explanations, and emotional-relational framing of moral evaluations of AI misconduct

Publication Details
Publication Date
2026-06-14
Journal
Publisher
ISSN
Cited by
0
Access Type
Author Information
Authors
Yue He
Guangzhi Deng
Chao Liu
Tian Gan
Fang Cui
Yi Luo
Ruolei Gu
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%