Causal Discovery with Language Models as Imperfect Experts
Stephanie Long Affiliation: McGill University Alexandre Piché Affiliation: Mila - Quebec AI Institute Affiliation: Université de Montréal Affiliation: ServiceNow Research Valentina Zantedeschi Affiliation: ServiceNow Research Correspondence to: Tibor Schuster Affiliation: McGill University Alexandre Drouin Affiliation: Mila - Quebec AI Institute Affiliation: ServiceNow Research
Abstract
Understanding the causal relationships that underlie a system is a fundamental prerequisite to accurate decision-making. In this work, we explore how expert knowledge can be used to improve the data-driven identification of causal graphs, beyond Markov equivalence classes. In doing so, we consider a setting where we can query an expert about the orientation of causal relationships between variables, but where the expert may provide erroneous information. We propose strategies for amending such expert knowledge based on consistency properties, e.g., acyclicity and conditional independencies in the equivalence class. We then report a case study, on real data, where a large language model is used as an imperfect expert.
原文 arXiv:2307.02390;中英对照 + 大白话阅读 https://aha.fim.ai/paper/2307.02390v1