论文标题
智能手机实时应用程序的感知图像增强
Perceptual Image Enhancement for Smartphone Real-Time Applications
论文作者
论文摘要
相机设计和成像管道的最新进展使我们能够使用智能手机捕获高质量的图像。但是,由于智能手机摄像机的尺寸和镜头限制很小,我们通常会在处理后的图像中发现伪影或退化。最常见的不愉快作用是噪声伪影,衍射伪像,模糊和HDR过度暴露。图像恢复的深度学习方法可以成功删除这些文物。但是,由于其大量计算和内存要求,大多数方法不适用于移动设备上的实时应用。在本文中,我们提出了LPIENET,这是一个轻巧的网络,用于增强感知图像,重点是将其部署在智能手机上。我们的实验表明,与标准基准的最新方法相比,我们的模型可以少得多,我们的模型可以处理上述工件并实现竞争性能。此外,为了证明我们方法的效率和可靠性,我们将模型直接部署在商用智能手机上,并评估了其性能。我们的模型可以在中层商业智能手机中处理2K分辨率图像。
Recent advances in camera designs and imaging pipelines allow us to capture high-quality images using smartphones. However, due to the small size and lens limitations of the smartphone cameras, we commonly find artifacts or degradation in the processed images. The most common unpleasant effects are noise artifacts, diffraction artifacts, blur, and HDR overexposure. Deep learning methods for image restoration can successfully remove these artifacts. However, most approaches are not suitable for real-time applications on mobile devices due to their heavy computation and memory requirements. In this paper, we propose LPIENet, a lightweight network for perceptual image enhancement, with the focus on deploying it on smartphones. Our experiments show that, with much fewer parameters and operations, our model can deal with the mentioned artifacts and achieve competitive performance compared with state-of-the-art methods on standard benchmarks. Moreover, to prove the efficiency and reliability of our approach, we deployed the model directly on commercial smartphones and evaluated its performance. Our model can process 2K resolution images under 1 second in mid-level commercial smartphones.