A Conceptual Introduction to Hamiltonian Monte Carlo
Michael [ Michael Betancourt is a research scientist in the Applied Statistics Center at Columbia University. Much of this review was completed as a Research Fellow at the Centre for Research in Statistical Methodology, University of Warwick, Coventry CV4 7AL, UK .
Abstract
Hamiltonian Monte Carlo has proven a remarkable empirical success, but only recently have we begun to develop a rigorous understanding of why it performs so well on difficult problems and how it is best applied in practice. Unfortunately, that understanding is confined within the mathematics of differential geometry which has limited its dissemination, especially to the applied communities for which it is particularly important.
中文速览
哈密顿蒙特卡洛（Hamiltonian Monte Carlo，HMC）是一种强大的概率采样算法，在贝叶斯统计等高维问题中表现出色，但其背后的理论根基建立在微分几何之上，令许多应用研究者望而却步。这篇文章用直觉化、几何化的语言，系统解释了HMC为何有效：高维概率分布的积分贡献主要集中在一个被称为"典型集"（typical set）的狭窄区域，而HMC借助物理学中的哈密顿动力学，能够沿着这个典型集高效滑行，而不会像随机游走那样频繁陷入无效区域。文章进一步讲解了如何通过自动调参（如NUTS算法）和内置诊断工具（如能量差异统计量）在实践中最优地使用HMC。这项工作的重要性在于，它填补了严格数学理论与实际应用之间的鸿沟，帮助统计学家和各领域从业者真正理解这一工具在什么情况下奏效、在什么情况下会出现问题，从而更可靠地应用于科学研究和工业实践。
原文 arXiv:1701.02434;中英对照 + 大白话阅读 https://aha.fim.ai/paper/1701.02434v2