论文标题
半监督实例分割的蒙版指导样品选择
Mask-guided sample selection for Semi-Supervised Instance Segmentation
论文作者
论文摘要
图像分割方法通常接受像素级注释训练,这需要大量的人为收集。解决此限制的最常见解决方案是实施经过较低形式的监督(例如边界框或涂鸦)训练的弱监督管道。另一个选择是半监督的方法,它利用大量未标记的数据和有限的强烈标记样本。在第二个设置中,可以随机选择要进行大量通知的样本,也可以使用有效的学习机制来选择最大化模型性能的样本。在这项工作中,我们提出了一种样本选择方法,以确定用于半监督实例分割的样本。我们的方法包括先预测未标记的样品池的伪口罩,以及预测掩模质量的分数。该分数是对与地面真相面具的分段联合(IOU)的交集的估计。我们研究哪些样品可以在质量评分的情况下更好地注释,并显示我们的方法的表现如何超过随机选择,从而改善了用低注释预算的半监督实例细分的性能。
Image segmentation methods are usually trained with pixel-level annotations, which require significant human effort to collect. The most common solution to address this constraint is to implement weakly-supervised pipelines trained with lower forms of supervision, such as bounding boxes or scribbles. Another option are semi-supervised methods, which leverage a large amount of unlabeled data and a limited number of strongly-labeled samples. In this second setup, samples to be strongly-annotated can be selected randomly or with an active learning mechanism that chooses the ones that will maximize the model performance. In this work, we propose a sample selection approach to decide which samples to annotate for semi-supervised instance segmentation. Our method consists in first predicting pseudo-masks for the unlabeled pool of samples, together with a score predicting the quality of the mask. This score is an estimate of the Intersection Over Union (IoU) of the segment with the ground truth mask. We study which samples are better to annotate given the quality score, and show how our approach outperforms a random selection, leading to improved performance for semi-supervised instance segmentation with low annotation budgets.