Clearing Opacity through Machine Learning

Устранение непрозрачности с помощью машинного обучения
W. Nicholson Price, Arti Kaur Rai
2020-01-01

algorithmic secrecyfundamental scientific knowledgeinnovation policymachine learning opacityscientific understanding
Artificial intelligence and machine learning provide powerful tools in many fields ranging from criminal justice to human biology to climate change. Part of the power of these tools arises from their ability to make predictions and glean useful information about complex real-world systems without the need to understand the workings of those systems.But these machine-learning tools are often as opaque as the underlying systems, whether because they are complex, nonintuitive, deliberately kept secret, or a synergistic combination of those three factors. A burgeoning literature addresses challenges arising from the opacity of machine-learning systems. This literature has largely focused on the benefits and difficulties of providing information to lay individuals, such as citizens impacted by algorithm-driven government decisions. In this Article, we explore the potential of machine learning to clear opacity — that is, to help drive scientific understanding of the frequently complex and nonintuitive real-world systems that machine-learning algorithms examine. Using multiple examples drawn from cutting-edge scientific research, we argue machine-learning algorithms can advance fundamental scientific knowledge and that deliberate secrecy around machine-learning tools restricts that learning enterprise. We examine why developers are likely to keep machine-learning systems secret, and the costs and benefits of that secrecy. Finally, we draw on the innovation policy toolbox to suggest ways to reduce secrecy so that machine learning can help us not only to interact with complex, non-intuitive real-world systems but also to understand them.
1
Deliberate secrecy surrounding machine-learning tools restricts scientific learning and limits the broader understanding these systems could generate.
2
Developers may keep machine-learning systems secret for identifiable costs-and-benefits reasons, creating a policy challenge involving transparency, innovation, and proprietary interests.
3
Examples from cutting-edge research indicate that machine-learning algorithms can reveal useful knowledge about underlying scientific systems without fully specifying their mechanisms.
4
Innovation-policy mechanisms could reduce secrecy and enable machine learning to support both interaction with and deeper understanding of complex real-world systems.
5
Machine-learning systems can reduce opacity in complex, nonintuitive real-world systems by advancing fundamental scientific understanding, not merely generating predictions.

Machine-learning systems examining complex and nonintuitive real-world systems

The capacity of machine learning to advance scientific understanding by reducing opacity, and the effects of secrecy surrounding these tools on that learning enterprise

Publication Details
Publication Date
2020-01-01
Journal
Publisher
ISSN
Access Type
Author Information
Authors
W. Nicholson Price
Arti Kaur Rai
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%