论文标题
投影追求高斯流程回归
Projection Pursuit Gaussian Process Regression
论文作者
论文摘要
计算机实验的主要目标是通过分散的评估重建计算机代码给出的功能。当输入维度相对较高时,传统的各向同性高斯过程模型遭受了维数的诅咒。具有加性相关功能的高斯过程模型可扩展到维度,但是它们仅适用于加性功能,因此更具限制性。在这项工作中,我们考虑了一种投影追求模型,在该模型中,非参数部分是由加性高斯过程回归驱动的。我们选择添加函数的维度高于原始输入维度,并将此策略称为“维度扩展”。我们表明,尺寸扩展可以帮助近似更复杂的功能。根据最大似然估计,提出了一种用于模型训练的梯度下降算法。仿真研究表明,所提出的方法的表现优于传统的高斯工艺模型。补充材料可在线获得。
A primary goal of computer experiments is to reconstruct the function given by the computer code via scattered evaluations. Traditional isotropic Gaussian process models suffer from the curse of dimensionality, when the input dimension is relatively high given limited data points. Gaussian process models with additive correlation functions are scalable to dimensionality, but they are more restrictive as they only work for additive functions. In this work, we consider a projection pursuit model, in which the nonparametric part is driven by an additive Gaussian process regression. We choose the dimension of the additive function higher than the original input dimension, and call this strategy "dimension expansion". We show that dimension expansion can help approximate more complex functions. A gradient descent algorithm is proposed for model training based on the maximum likelihood estimation. Simulation studies show that the proposed method outperforms the traditional Gaussian process models. The Supplementary Materials are available online.