Autonomous artificial intelligence, scientific research, and human values

Автономный искусственный интеллект, научные исследования и человеческие ценности
David B. Resnik, Mohammad Hosseini, Rico Hauswald
2026-02-01

AI agentsAI research ethicsAI-augmented scientific researchautonomous artificial intelligencehuman supervision and control
During the initial stage of AI's incorporation into scientific research, AI systems have functioned predominantly as tools under direct human supervision and control. However, AI incorporation into scientific research is now entering a stage in which AI Agents perform research tasks with partial autonomy while remaining under human supervision and control. In the not-too-distant future, a third stage may arise when autonomous AI systems conduct their own research and generate knowledge without human supervision or control. While the second and third stages of AI-augmented research may offer substantial benefits for science and society, they also create novel ethical issues, including (1) Conducting immoral research that may harm humans and other forms of life; (2) Increasing rate of biased, erroneous and deceptive research; (3) Confidentiality challenges; (4) Overreliance on AI; (5) Diffusion of responsibility and accountability; (6) Deskilling; (7) Job losses; (8) AI-generated research beyond human comprehension; and (9) Erosion of trust. We suggest specific solutions to minimize the negative consequences of these issues and offer proposals for ensuring that incorporation of AI into scientific research supports human values.
1
AI integration into scientific research is progressing from human-controlled tools toward partially autonomous agents and potentially fully autonomous knowledge-generating systems.
2
Partially and fully autonomous AI research could provide substantial benefits for science and society, but may operate without direct human supervision in later stages.
3
The abstract identifies nine ethical risks, including harmful research, increased bias and deception, confidentiality breaches, overreliance, accountability gaps, deskilling, job losses, incomprehensible outputs, and declining trust.
4
The paper proposes specific measures to reduce these risks and argues that AI incorporation into research should be guided by human values.

Autonomous AI systems performing scientific research

The ethical risks, societal consequences, and value-aligned governance solutions associated with increasing AI autonomy in scientific research

Publication Details
Publication Date
2026-02-01
Journal
Publisher
ISSN
Cited by
6
Access Type
Author Information
Authors
David B. Resnik
Mohammad Hosseini
Rico Hauswald
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%