论文标题
基于模拟推断的组成分数建模
Compositional Score Modeling for Simulation-based Inference
论文作者
论文摘要
基于模拟的推理的神经后验估计方法可能不适合通过根据多个观测值进行条件来处理后验分布,因为它们倾向于需要大量的模拟器调用以学习准确的近似值。相比之下,神经可能性估计方法可以在从单个观察中学习后的推理时间处理多个观察,但它们依赖于标准的推理方法,例如MCMC或变异推断,这会带来某些性能弊端。我们介绍了一种基于条件分数建模的新方法,该方法享有两种方法的好处。我们对单个观察值引起的(扩散)后分布的分数进行建模,并引入一种将学习分数组合到大约从目标后分布样本的方法。我们的方法是样本效率的,可以在推理时间自然汇总多个观察,并避免标准推理方法的缺点。
Neural Posterior Estimation methods for simulation-based inference can be ill-suited for dealing with posterior distributions obtained by conditioning on multiple observations, as they tend to require a large number of simulator calls to learn accurate approximations. In contrast, Neural Likelihood Estimation methods can handle multiple observations at inference time after learning from individual observations, but they rely on standard inference methods, such as MCMC or variational inference, which come with certain performance drawbacks. We introduce a new method based on conditional score modeling that enjoys the benefits of both approaches. We model the scores of the (diffused) posterior distributions induced by individual observations, and introduce a way of combining the learned scores to approximately sample from the target posterior distribution. Our approach is sample-efficient, can naturally aggregate multiple observations at inference time, and avoids the drawbacks of standard inference methods.