论文标题
Metaiqa:无参考图像质量评估的深度元学习
MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessment
论文作者
论文摘要
最近,在利用深层卷积神经网络(DCNN)进行无引用图像质量评估(NR-IQA)方面,人们提出了越来越多的兴趣。尽管取得了显着的成功,但仍有广泛的共识,即培训DCNN在很大程度上依赖于大量注释的数据。不幸的是,IQA是一个典型的小样本问题。因此,大多数现有基于DCNN的IQA指标都基于预训练的网络运行。但是,这些预训练的网络不是为IQA任务设计的,在评估不同类型的扭曲时会导致概括问题。有了这一动机,本文提出了基于深度学习的无参考iQA指标。基本的想法是在评估各种扭曲的图像质量时学习人类共享的元知识,然后可以轻松地适应未知的扭曲。具体而言,我们首先收集许多用于不同失真的NR-IQA任务。然后采用元学习来学习多元化扭曲所共有的先验知识。最后,在目标NR-IQA任务上对质量先验模型进行了微调,以快速获得质量模型。广泛的实验表明,拟议的度量标准的表现要优于最先进的余量。此外,从合成失真中学到的元模型也可以很容易地将其推广到真实的畸变,这在IQA指标的实际应用中是高度满足的。
Recently, increasing interest has been drawn in exploiting deep convolutional neural networks (DCNNs) for no-reference image quality assessment (NR-IQA). Despite of the notable success achieved, there is a broad consensus that training DCNNs heavily relies on massive annotated data. Unfortunately, IQA is a typical small sample problem. Therefore, most of the existing DCNN-based IQA metrics operate based on pre-trained networks. However, these pre-trained networks are not designed for IQA task, leading to generalization problem when evaluating different types of distortions. With this motivation, this paper presents a no-reference IQA metric based on deep meta-learning. The underlying idea is to learn the meta-knowledge shared by human when evaluating the quality of images with various distortions, which can then be adapted to unknown distortions easily. Specifically, we first collect a number of NR-IQA tasks for different distortions. Then meta-learning is adopted to learn the prior knowledge shared by diversified distortions. Finally, the quality prior model is fine-tuned on a target NR-IQA task for quickly obtaining the quality model. Extensive experiments demonstrate that the proposed metric outperforms the state-of-the-arts by a large margin. Furthermore, the meta-model learned from synthetic distortions can also be easily generalized to authentic distortions, which is highly desired in real-world applications of IQA metrics.