Nonparametric Identifiability of Causal Representations from Unknown Interventions
Julius von Kügelgen Affiliation: Max Planck Institute for Intelligent Systems, Tübingen, Germany Affiliation: Department of Engineering, University of Cambridge, United Kingdom Michel Besserve Affiliation: Max Planck Institute for Intelligent Systems, Tübingen, Germany Liang Wendong Affiliation: Max Planck Institute for Intelligent Systems, Tübingen, Germany Luigi Gresele Affiliation: Max Planck Institute for Intelligent Systems, Tübingen, Germany Armin Kekić Affiliation: Max Planck Institute for Intelligent Systems, Tübingen, Germany Elias Bareinboim Affiliation: Columbia University, USA David M. Blei Affiliation: Columbia University, USA Bernhard Schölkopf Affiliation: Max Planck Institute for Intelligent Systems, Tübingen, Germany
Abstract
We study causal representation learning, the task of inferring latent causal variables and their causal relations from high-dimensional functions (“mixtures”) of the variables. Prior work relies on weak supervision, in the form of counterfactual pre- and post-intervention views or temporal structure; places restrictive assumptions, such as linearity, on the mixing function or latent causal model; or requires partial knowledge of the generative process, such as the causal graph or intervention targets. We instead consider the general setting in which both the causal model and the mixing function are nonparametric. The learning signal takes the form of multiple datasets, or environments, arising from unknown interventions in the underlying causal model. Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data. We study the fundamental setting of two causal variables and prove that the observational distribution and one perfect intervention per node suffice for identifiability, subject to a genericity condition. This condition rules out spurious solutions that involve fine-tuning o
原文 arXiv:2306.00542;中英对照 + 大白话阅读 https://aha.fim.ai/paper/2306.00542v2