论文标题
关于将任务信息纳入基于学习的图像Denoising的影响
On the impact of incorporating task-information in learning-based image denoising
论文作者
论文摘要
已经提出了各种基于深层神经网络(DNN)的图像denoising方法,可与医学图像一起使用。这些方法通常是通过最大程度地减少量化损失函数的训练的,该损失函数量化了deno的图像之间的距离或它的转换版本之间的距离,以及定义的目标图像(例如,无噪声或低噪声图像)。他们在传统图像质量指标(例如均方根误差(RMSE),结构相似性指数量度(SSIM)或峰值信噪比(PSNR)等传统图像质量指标方面都表现出了高度性能。但是,最近据报道,这种脱泽的方法可能并不总是提高图像质量的客观度量。在这项工作中,建立了一种基于任务的DNN图像Denoising方法并系统地评估。采用了一种转移学习方法,其中DNN首先通过使用常规(非任务)损耗函数进行预训练,然后通过使用包括任务组件的混合损失进行微调。该任务组件旨在测量信号检测任务上数值观察者(NO)的性能。探索了网络深度和将微调限制到DNN的特定层的影响。在风格化的低剂量X射线计算机断层扫描(CT)denoising研究中研究了任务信息的训练方法,该研究对信号态态下(SKS)下的二进制信号检测任务(SKS)考虑了背景(BKS)条件。在推理时间更改指定任务的影响与模型培训所采用的任务不同,我们称之为“任务换档”的现象。提出的结果表明,任务信息的训练方法可以改善观察者的性能,同时控制传统和基于任务的图像质量测量方法之间的权衡。
A variety of deep neural network (DNN)-based image denoising methods have been proposed for use with medical images. These methods are typically trained by minimizing loss functions that quantify a distance between the denoised image, or a transformed version of it, and the defined target image (e.g., a noise-free or low-noise image). They have demonstrated high performance in terms of traditional image quality metrics such as root mean square error (RMSE), structural similarity index measure (SSIM), or peak signal-to-noise ratio (PSNR). However, it has been reported recently that such denoising methods may not always improve objective measures of image quality. In this work, a task-informed DNN-based image denoising method was established and systematically evaluated. A transfer learning approach was employed, in which the DNN is first pre-trained by use of a conventional (non-task-informed) loss function and subsequently fine-tuned by use of the hybrid loss that includes a task-component. The task-component was designed to measure the performance of a numerical observer (NO) on a signal detection task. The impact of network depth and constraining the fine-tuning to specific layers of the DNN was explored. The task-informed training method was investigated in a stylized low-dose X-ray computed tomography (CT) denoising study for which binary signal detection tasks under signal-known-statistically (SKS) with background-known-statistically (BKS) conditions were considered. The impact of changing the specified task at inference time to be different from that employed for model training, a phenomenon we refer to as "task-shift", was also investigated. The presented results indicate that the task-informed training method can improve observer performance while providing control over the trade off between traditional and task-based measures of image quality.