论文标题

基于捕获的视频序列的点云的无参考质量评估指标

A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences

论文作者

Fan, Yu, Zhang, Zicheng, Sun, Wei, Min, Xiongkuo, Lu, Wei, Wang, Tao, Liu, Ning, Zhai, Guangtao

论文摘要

Point Cloud是3D模型中使用最广泛的数字格式之一,其视觉质量对扭曲(例如下采样,噪声和压缩)非常敏感。为了在没有参考的情况下应对点云质量评估(PCQA)的挑战,我们建议基于捕获的视频序列对有色点云进行无参考质量评估指标。具体而言,通过将摄像机围绕点云旋转三个特定轨道来获得三个视频序列。视频序列不仅包含静态视图,还包含多帧的时间信息,这极大地有助于了解人类对点云的感知。然后,我们将RESNET3D修改为特征提取模型,以了解捕获视频与相应的主观质量分数之间的相关性。实验结果表明,我们的方法的表现优于最先进的全参考和无参考PCQA指标,从而验证了所提出的方法的有效性。

Point cloud is one of the most widely used digital formats of 3D models, the visual quality of which is quite sensitive to distortions such as downsampling, noise, and compression. To tackle the challenge of point cloud quality assessment (PCQA) in scenarios where reference is not available, we propose a no-reference quality assessment metric for colored point cloud based on captured video sequences. Specifically, three video sequences are obtained by rotating the camera around the point cloud through three specific orbits. The video sequences not only contain the static views but also include the multi-frame temporal information, which greatly helps understand the human perception of the point clouds. Then we modify the ResNet3D as the feature extraction model to learn the correlation between the capture videos and corresponding subjective quality scores. The experimental results show that our method outperforms most of the state-of-the-art full-reference and no-reference PCQA metrics, which validates the effectiveness of the proposed method.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源