Causal Component Analysis
Liang Wendong 1,212{}^{1,2}start_FLOATSUPERSCRIPT 1 , 2 end_FLOATSUPERSCRIPT、Armin Kekić 11{}^{1}start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT、Julius von Kügelgen 1,313{}^{1,3}start_FLOATSUPERSCRIPT 1 , 3 end_FLOATSUPERSCRIPT、Simon Buchholz 11{}^{1}start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Michel Besserve 11{}^{1}start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Luigi Gresele 11{}^{1}start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Bernhard Schölkopf 11{}^{1}start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT 11{}^{1}start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Max Planck Institute for Intelligent Systems, Tübingen, Germany 22{}^{2}start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT ENS Paris-Saclay, Gif-sur-Yvette, France 33{}^{3}start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT University of Cambridge, United Kingdom Shared last author. Code available at https://github.com/akekic/causal-component-analysis.
Abstract
Independent Component Analysis (ICA) aims to recover independent latent variables from observed mixtures thereof. Causal Representation Learning (CRL) aims instead to infer causally related (thus often statistically dependent) latent variables, together with the unknown graph encoding their causal relationships. We introduce an intermediate problem termed Causal Component Analysis (CauCA). CauCA can be viewed as a generalization of ICA, modelling the causal dependence among the latent components, and as a special case of CRL. In contrast to CRL, it presupposes knowledge of the causal graph, focusing solely on learning the unmixing function and the causal mechanisms. Any impossibility results regarding the recovery of the ground truth in CauCA also apply for CRL, while possibility results may serve as a stepping stone for extensions to CRL. We characterize CauCA identifiability from multiple datasets generated through different types of interventions on the latent causal variables. As a corollary, this interventional perspective also leads to new identifiability results for nonlinear ICA—a special case of CauCA with an empty graph—requiring strictly fewer datasets than previous resu
原文 arXiv:2305.17225;中英对照 + 大白话阅读 https://aha.fim.ai/paper/2305.17225v3