论文标题

跨域中的层次实例混合空中分段

Hierarchical Instance Mixing across Domains in Aerial Segmentation

论文作者

Arnaudo, Edoardo, Tavera, Antonio, Dominici, Fabrizio, Masone, Carlo, Caputo, Barbara

论文摘要

我们研究了空中语义分割中无监督的域适应性的任务,并发现目前设计用于基于域混合的自动驾驶的最新算法并不能很好地转化为空中环境。这是由于两个因素造成的:(i)语义类别的扩展的差异很大,这会导致混合图像中的域失衡,以及(ii)空中场景中的结构一致性较弱,因为从不同的角度看,也可能从不同的角度观察相同的场景,并且图像中没有明确且可重复的元素结构。我们解决这些问题的解决方案包括:(i)一种新的混合策略,用于跨称为层次实例混合(HIMIX)的领域的空气段,该策略从每个语义面具中提取一组连接的组件,并根据语义层次结构和(ii)在两个单独的构造中融合了variations for firations for fin firations for fin firations for for for for for for for far for v vary for for far for var for for far for。我们在Loveda基准测试上进行了广泛的实验,我们的解决方案的表现优于当前的最新面积。

We investigate the task of unsupervised domain adaptation in aerial semantic segmentation and discover that the current state-of-the-art algorithms designed for autonomous driving based on domain mixing do not translate well to the aerial setting. This is due to two factors: (i) a large disparity in the extension of the semantic categories, which causes a domain imbalance in the mixed image, and (ii) a weaker structural consistency in aerial scenes than in driving scenes since the same scene might be viewed from different perspectives and there is no well-defined and repeatable structure of the semantic elements in the images. Our solution to these problems is composed of: (i) a new mixing strategy for aerial segmentation across domains called Hierarchical Instance Mixing (HIMix), which extracts a set of connected components from each semantic mask and mixes them according to a semantic hierarchy and, (ii) a twin-head architecture in which two separate segmentation heads are fed with variations of the same images in a contrastive fashion to produce finer segmentation maps. We conduct extensive experiments on the LoveDA benchmark, where our solution outperforms the current state-of-the-art.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源