论文标题
分辨率增强和逼真的斑点恢复,并通过微光学相干断层扫描的生成对抗建模
Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography
论文作者
论文摘要
开发和研究了基于生成对抗网络(GAN)的光学相干断层扫描(OCT)的分辨率增强技术。先前已将gans用于分辨摄影和光学显微镜图像的分辨率。我们已经适应并改进了此技术以生成OCT图像。在一组新型的超高分辨率光谱域OCT体积上训练有条件的gans(CGAN),称为Micro-OCT,作为高分辨率地面真理(〜1 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $同位素分辨率)。地面真相与通过在(1-D)或轴向和侧轴(2-D)中合成下分辨率4X获得的低分辨率图像配对。通过在单独的可行性实验中使用了从人体唇(唇)组织和小鼠皮肤的体内成像获得的横截面图像(B扫描)体积。与地面真相相比,通过OCT专家进行的人类感知准确性测试量化了分辨率增强的准确性。在优化目标中,GAN损失,发电机和鉴别器模型中的噪声注入以及多尺度歧视对于在生成的OCT图像中实现逼真的斑点外观很重要。高分辨率斑点恢复的实用性通过唇组织中血管的微观成像的示例说明了。还展示了将模型应用于训练数据分布外部图像数据的定性示例,即人类视网膜和小鼠膀胱,这表明可能具有跨域转移性。这项初步研究表明,在高性能原型系统上对OCT图像进行训练的深度学习生成模型可能具有增强主流/商业系统的较低分辨率数据的潜力,从而以低成本为群众带来了尖端的技术。
A resolution enhancement technique for optical coherence tomography (OCT), based on Generative Adversarial Networks (GANs), was developed and investigated. GANs have been previously used for resolution enhancement of photography and optical microscopy images. We have adapted and improved this technique for OCT image generation. Conditional GANs (cGANs) were trained on a novel set of ultrahigh resolution spectral domain OCT volumes, termed micro-OCT, as the high-resolution ground truth (~1$μ$m isotropic resolution). The ground truth was paired with a low-resolution image obtained by synthetically degrading resolution 4x in one of (1-D) or both axial and lateral axes (2-D). Cross-sectional image (B-scan) volumes obtained from in vivo imaging of human labial (lip) tissue and mouse skin were used in separate feasibility experiments. Accuracy of resolution enhancement compared to ground truth was quantified with human perceptual accuracy tests performed by an OCT expert. The GAN loss in the optimization objective, noise injection in both the generator and discriminator models, and multi-scale discrimination were found to be important for achieving realistic speckle appearance in the generated OCT images. The utility of high resolution speckle recovery was illustrated by an example of micro-OCT imaging of blood vessels in lip tissue. Qualitative examples applying the models to image data from outside of the training data distribution, namely human retina and mouse bladder, were also demonstrated, suggesting potential for cross-domain transferability. This preliminary study suggests that deep learning generative models trained on OCT images from high-performance prototype systems may have potential in enhancing lower resolution data from mainstream/commercial systems, thereby bringing cutting-edge technology to the masses at low cost.