论文标题
通过解剖学对比蒸馏进行引导半监督医学图像分割
Bootstrapping Semi-supervised Medical Image Segmentation with Anatomical-aware Contrastive Distillation
论文作者
论文摘要
对比度学习在医学图像分割的背景下对注释稀缺问题表现出了巨大的希望。现有方法通常假设标签和未标记的医学图像的平衡班级分布。但是,现实中的医学图像数据通常是不平衡的(即多级标签失衡),这自然会产生模糊的轮廓,通常会错误地标记稀有物体。此外,尚不清楚所有负样本是否同样负面。在这项工作中,我们提出动作是半监督医学图像分割的解剖学对比蒸馏框架。具体而言,我们首先通过软标记底片而不是正面和负面对之间的二进制监督来开发一种迭代对比蒸馏算法。与实施采样数据的多样性相比,我们还从随机选择的负集捕获了从随机选择的负集中捕获更相似的特征。其次,我们提出了一个更重要的问题:我们可以真正处理不平衡的样本以产生更好的性能吗?因此,行动中的关键创新是学习整个数据集的全球语义关系以及相邻像素的局部解剖特征,并具有最小的其他内存足迹。在训练过程中,我们通过积极采样一组稀疏的硬性像素来引入解剖对比度,这些像素可以产生更平滑的分割边界和更准确的预测。在两个基准数据集和不同未标记的设置上进行的广泛实验表明,动作明显优于当前最新的半监督方法。
Contrastive learning has shown great promise over annotation scarcity problems in the context of medical image segmentation. Existing approaches typically assume a balanced class distribution for both labeled and unlabeled medical images. However, medical image data in reality is commonly imbalanced (i.e., multi-class label imbalance), which naturally yields blurry contours and usually incorrectly labels rare objects. Moreover, it remains unclear whether all negative samples are equally negative. In this work, we present ACTION, an Anatomical-aware ConTrastive dIstillatiON framework, for semi-supervised medical image segmentation. Specifically, we first develop an iterative contrastive distillation algorithm by softly labeling the negatives rather than binary supervision between positive and negative pairs. We also capture more semantically similar features from the randomly chosen negative set compared to the positives to enforce the diversity of the sampled data. Second, we raise a more important question: Can we really handle imbalanced samples to yield better performance? Hence, the key innovation in ACTION is to learn global semantic relationship across the entire dataset and local anatomical features among the neighbouring pixels with minimal additional memory footprint. During the training, we introduce anatomical contrast by actively sampling a sparse set of hard negative pixels, which can generate smoother segmentation boundaries and more accurate predictions. Extensive experiments across two benchmark datasets and different unlabeled settings show that ACTION significantly outperforms the current state-of-the-art semi-supervised methods.