EIGEN: Event Influence GENeration using Pre-trained Language Models
Aman Madaan Thanks: authors contributed equally to this work. Dheeraj Rajagopal Yiming Yang Affiliation: Abhilasha Ravichander, Eduard Hovy, Shrimai Prabhumoye Affiliation: Language Technologies Institute, Carnegie Mellon University Affiliation: Pittsburgh, PA, USA Email:
Abstract
Reasoning about events and tracking their influences is fundamental to understanding processes. In this paper, we present eigen - a method to leverage pre-trained language models to generate event influences conditioned on a context, nature of their influence, and the distance in a reasoning chain. We also derive a new dataset for research and evaluation of methods for event influence generation. eigen outperforms strong baselines both in terms of automated evaluation metrics (by 10 rouge points) and human judgments on closeness to reference and relevance of generations. Furthermore, we show that the event influences generated by eigen improve the performance on a “what-if” Question Answering (wiqa) benchmark (over 3% F1), especially for questions that require background knowledge and multi-hop reasoning.
原文 arXiv:2010.11764;中英对照 + 大白话阅读 https://aha.fim.ai/paper/2010.11764v1