Toward Causal Representation Learning

К стремлению к обучению причинных представлений
Yoshua Bengio, Bernhard Schölkopf, Anirudh Goyal, Stefan Bauer, Nal Kalchbrenner, Francesco Locatello, Nan Rosemary Ke
2021-02-26

causal inferencecausal representation learningdiscovery of high-level causal variablesgraphical causalitytransfer and generalization
The two fields of machine learning and graphical causality arose and are developed separately. However, there is, now, cross-pollination and increasing interest in both fields to benefit from the advances of the other. In this article, we review fundamental concepts of causal inference and relate them to crucial open problems of machine learning, including transfer and generalization, thereby assaying how causality can contribute to modern machine learning research. This also applies in the opposite direction: we note that most work in causality starts from the premise that the causal variables are given. A central problem for AI and causality is, thus, causal representation learning, that is, the discovery of high-level causal variables from low-level observations. Finally, we delineate some implications of causality for machine learning and propose key research areas at the intersection of both communities.
1
Causal representation learning—the discovery of high-level causal variables from low-level observations—is identified as a central open problem.
2
Causality concepts can address core ML problems like transfer and generalization by relating causal inference to these challenges.
3
Most causal inference work assumes causal variables are given, highlighting a central gap in both AI and causality.
4
The paper proposes key interdisciplinary research directions at the intersection of causality and machine learning and outlines implications of causality for ML research.
5
There is increasing cross-pollination between machine learning and graphical causality, with mutual benefits for both fields.

Causal representation learning (discovery of high-level causal variables from low-level observations)

Methods and principles for discovering and validating high-level causal variables and their causal relationships from observational data to support transfer, generalization, and causal inference in machine learning

Publication Details
Publication Date
2021-02-26
Journal
Publisher
ISSN
Cited by
1142
Access Type
Author Information
Authors
Yoshua Bengio
Bernhard Schölkopf
Anirudh Goyal
Stefan Bauer
Nal Kalchbrenner
Francesco Locatello
Nan Rosemary Ke
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%