论文标题
通过对比因果学习的领域概括
Domain Generalization via Contrastive Causal Learning
论文作者
论文摘要
域的概括(DG)旨在学习一个可以很好地概括从一组源域中看不见的目标域的模型。有了不变的因果机制的想法,已经为学习强大的因果效应所付出了许多努力,这些因果效应由对象确定但对域变化不敏感。尽管因果影响不变,但很难被量化和优化。受到人类通过先验知识适应新环境的能力的启发,我们开发了一种新颖的对比因果模型(CCM)传递看不见的图像以教授知识,这些知识是可见图像的特征,并基于教学知识来量化因果效应。考虑到转移受DG中的域移位影响,我们提出了一个更具包容性的因果图来描述DG任务。基于此因果图,CCM控制域因子以切断多余的因果路径,并使用其余部分通过前门标准计算图像的因果效应。具体而言,CCM由三个组成部分组成:(i)域条件的监督学习,教授CCM图像和标签之间的相关性,(ii)有助于CCM衡量图像对标签的真正因果效应的因果效应学习,(iii)对比相似性学习,哪些属于同一类别的图像的特征,并提供了相似性的特征。最后,我们在包括PAC,OfficeHome和TerrainCognita在内的多个数据集上测试CCM的性能。广泛的实验表明,CCM超过了先前的DG方法,其边缘清晰。
Domain Generalization (DG) aims to learn a model that can generalize well to unseen target domains from a set of source domains. With the idea of invariant causal mechanism, a lot of efforts have been put into learning robust causal effects which are determined by the object yet insensitive to the domain changes. Despite the invariance of causal effects, they are difficult to be quantified and optimized. Inspired by the ability that humans adapt to new environments by prior knowledge, We develop a novel Contrastive Causal Model (CCM) to transfer unseen images to taught knowledge which are the features of seen images, and quantify the causal effects based on taught knowledge. Considering the transfer is affected by domain shifts in DG, we propose a more inclusive causal graph to describe DG task. Based on this causal graph, CCM controls the domain factor to cut off excess causal paths and uses the remaining part to calculate the causal effects of images to labels via the front-door criterion. Specifically, CCM is composed of three components: (i) domain-conditioned supervised learning which teaches CCM the correlation between images and labels, (ii) causal effect learning which helps CCM measure the true causal effects of images to labels, (iii) contrastive similarity learning which clusters the features of images that belong to the same class and provides the quantification of similarity. Finally, we test the performance of CCM on multiple datasets including PACS, OfficeHome, and TerraIncognita. The extensive experiments demonstrate that CCM surpasses the previous DG methods with clear margins.