Can Foundation Models Talk Causality?
Moritz Willig Affiliation: Computer Science Department TU Darmstadt Darmstadt, Germany Affiliation: co-first authorship Matej Zečević Affiliation: Computer Science Department TU Darmstadt Darmstadt, Germany Affiliation: co-first authorship Devendra Singh Dhami Affiliation: Computer Science Department TU Darmstadt Darmstadt, Germany Affiliation: Hessian Center for AI (hessian.AI) Germany Kristian Kersting Affiliation: Computer Science Department TU Darmstadt Darmstadt, Germany Affiliation: Centre for Cognitive Science TU Darmstadt Darmstadt, Germany Affiliation: Hessian Center for AI (hessian.AI) Germany
Abstract
Foundation models are subject to an ongoing heated debate, leaving open the question of progress towards AGI and dividing the community into two camps: the ones who see the arguably impressive results as evidence to the scaling hypothesis, and the others who are worried about the lack of interpretability and reasoning capabilities. By investigating to which extent causal representations might be captured by these large scale language models, we make a humble efforts towards resolving the ongoing philosophical conflicts.
原文 arXiv:2206.10591;中英对照 + 大白话阅读 https://aha.fim.ai/paper/2206.10591v2