论文标题
通过深层协同图像和医学图像分割的特征对齐方式适应无监督的双向交叉模式适应
Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation
论文作者
论文摘要
无监督的域适应性越来越多地对医学图像计算产生了兴趣,旨在解决具有异构特征的看不见数据时,旨在解决深层神经网络的性能下降。在这项工作中,我们提出了一个新颖的无监督域自适应框架,称为协同图像和特征对齐(SIFA),以有效地使分割网络适应未标记的目标域。我们提出的SIFA从图像和特征角度进行域的协同对准。特别是,我们同时通过在多个方面和深入监督的机制中利用对抗性学习,从而增强了跨域的图像的外观,并通过利用对抗性学习来增强提取特征的域不变。两种自适应观点之间共享该功能编码器,以通过端到端学习利用其相互利益。我们已经通过心脏子结构分割和腹部多器官分割对我们的方法进行了广泛的评估,以在MRI和CT图像之间进行双向跨模式适应。对两个不同任务的实验结果表明,我们的SIFA方法有效地改善了未标记的目标图像的分割性能,并且要超过最新的域适应方法。
Unsupervised domain adaptation has increasingly gained interest in medical image computing, aiming to tackle the performance degradation of deep neural networks when being deployed to unseen data with heterogeneous characteristics. In this work, we present a novel unsupervised domain adaptation framework, named as Synergistic Image and Feature Alignment (SIFA), to effectively adapt a segmentation network to an unlabeled target domain. Our proposed SIFA conducts synergistic alignment of domains from both image and feature perspectives. In particular, we simultaneously transform the appearance of images across domains and enhance domain-invariance of the extracted features by leveraging adversarial learning in multiple aspects and with a deeply supervised mechanism. The feature encoder is shared between both adaptive perspectives to leverage their mutual benefits via end-to-end learning. We have extensively evaluated our method with cardiac substructure segmentation and abdominal multi-organ segmentation for bidirectional cross-modality adaptation between MRI and CT images. Experimental results on two different tasks demonstrate that our SIFA method is effective in improving segmentation performance on unlabeled target images, and outperforms the state-of-the-art domain adaptation approaches by a large margin.