论文标题

MSTRIQ:没有基于SWIN Transformer的参考图像质量评估,具有多阶段融合

MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusion

论文作者

Wang, Jing, Fan, Haotian, Hou, Xiaoxia, Xu, Yitian, Li, Tao, Lu, Xuechao, Fu, Lean

论文摘要

自动测量图像的感知质量是计算机视觉领域的重要任务,因为从图像获取,传输到增强的许多过程中,图像质量的降解都可以存在。许多图像质量评估(IQA)算法旨在解决此问题。但是,由于各种类型的图像扭曲和缺乏大规模的人级数据集,它仍然无法解决。在本文中,我们提出了一种基于SWIN Transformer [31]的新型算法,并具有来自多个阶段的融合功能,该功能汇总了本地和全球特征的信息,以更好地预测质量。为了解决小规模数据集的问题,已经考虑了图像的相对排名以及回归损失以同时优化模型。此外,有效的数据增强策略也用于提高性能。在与以前的工作进行比较中,实验是在两个标准的IQA数据集和一个挑战数据集上进行的。结果证明了我们工作的有效性。所提出的方法在标准数据集上的其他方法优于其他方法,并在NTIRE 2022知觉图像质量评估挑战的无参考曲目中排名第二[53]。它验证了我们的方法在解决不同的iQA问题方面有希望,因此可以用于现实词应用程序。

Measuring the perceptual quality of images automatically is an essential task in the area of computer vision, as degradations on image quality can exist in many processes from image acquisition, transmission to enhancing. Many Image Quality Assessment(IQA) algorithms have been designed to tackle this problem. However, it still remains un settled due to the various types of image distortions and the lack of large-scale human-rated datasets. In this paper, we propose a novel algorithm based on the Swin Transformer [31] with fused features from multiple stages, which aggregates information from both local and global features to better predict the quality. To address the issues of small-scale datasets, relative rankings of images have been taken into account together with regression loss to simultaneously optimize the model. Furthermore, effective data augmentation strategies are also used to improve the performance. In comparisons with previous works, experiments are carried out on two standard IQA datasets and a challenge dataset. The results demonstrate the effectiveness of our work. The proposed method outperforms other methods on standard datasets and ranks 2nd in the no-reference track of NTIRE 2022 Perceptual Image Quality Assessment Challenge [53]. It verifies that our method is promising in solving diverse IQA problems and thus can be used to real-word applications.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源