论文标题

半签名的优先神经拟合,用于从无调点云的表面重建

Semi-signed prioritized neural fitting for surface reconstruction from unoriented point clouds

论文作者

Zhu, Runsong, Kang, Di, Hui, Ka-Hei, Qian, Yue, Zhe, Xuefei, Dong, Zhen, Bao, Linchao, Heng, Pheng-Ann, Fu, Chi-Wing

论文摘要

从\ emph {nocedended}点云中重建3D几何形状可以使许多下游任务受益。最近的形状建模方法主要采用隐式神经表示,以适合签名的距离字段(SDF),并通过\ emph {unsigned}监督优化网络。但是,这些方法有时很难找到复杂物体的粗糙形状,尤其是患有``幽灵''表面(\ ie,不应该存在的假表面)。为了引导网络快速适合粗糙的形状,我们建议在显然在对象外部并可以轻松确定的区域中使用签名的监督,从而导致我们的半签名监督。为了更好地恢复高保真的细节,基于跟踪区域损失的新颖重要性采样和进行性位置编码(PE)优先考虑优化不足和复杂的区域。具体来说,我们将对象空间弹并分配到\ emph {sign-newand}和\ emph {sign-unawern}区域,其中应用了不同的监督。此外,我们根据跟踪的重建损失自适应地调整每个体素的采样率,以便网络可以更多地关注复杂的拟合不足区域。为此,我们提出了我们的半签名优先(SSP)神经拟合,并进行广泛的实验,以证明SSP在包括ABC子集和各种具有挑战性的数据在内的多个数据集上实现了最先进的性能。该代码将在出版物上发布。

Reconstructing 3D geometry from \emph{unoriented} point clouds can benefit many downstream tasks. Recent shape modeling methods mostly adopt implicit neural representation to fit a signed distance field (SDF) and optimize the network by \emph{unsigned} supervision. However, these methods occasionally have difficulty in finding the coarse shape for complicated objects, especially suffering from the ``ghost'' surfaces (\ie, fake surfaces that should not exist). To guide the network quickly fit the coarse shape, we propose to utilize the signed supervision in regions that are obviously outside the object and can be easily determined, resulting in our semi-signed supervision. To better recover high-fidelity details, a novel importance sampling based on tracked region losses and a progressive positional encoding (PE) prioritize the optimization towards underfitting and complicated regions. Specifically, we voxelize and partition the object space into \emph{sign-known} and \emph{sign-uncertain} regions, in which different supervisions are applied. Besides, we adaptively adjust the sampling rate of each voxel according to the tracked reconstruction loss, so that the network can focus more on the complicated under-fitting regions. To this end, we propose our semi-signed prioritized (SSP) neural fitting, and conduct extensive experiments to demonstrate that SSP achieves state-of-the-art performance on multiple datasets including the ABC subset and various challenging data. The code will be released upon the publication.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源