论文标题

共同自我校准DERANEN网络的联合自我注意力和规模聚集

Joint Self-Attention and Scale-Aggregation for Self-Calibrated Deraining Network

论文作者

Wang, Cong, Wu, Yutong, Su, Zhixun, Chen, Junyang

论文摘要

在多媒体领域,单图像是一项基本的预处理作品,可以大大改善随后在多雨条件下的高级任务的视觉效果。在本文中,我们提出了一种称为JDNET的有效算法,以解决单个图像问题,并为应用程序执行分割和检测任务。具体而言,考虑到有关多尺度功能的重要信息,我们提出了一个比例聚集模块,以学习不同尺度的功能。同时,引入了自我主意模块以匹配或胜过其卷积对应物,从而使特征聚合能够适应每个通道。此外,为了改善卷积神经网络(CNN)的基本卷积特征转换过程,应用自校准的卷积来构建每个空间位置周围的长距离空间和渠道间依赖关系,以明确地通过内部通讯和从而丰富了输出功能,从而明确地扩展了每个卷积层的卷积场。通过熟练地设计具有自校准的卷积的规模 - 聚集和自我发项模块,该模型在现实世界和合成数据集上都可以更好地确定结果。进行了广泛的实验,以证明我们方法的优越性与最先进的方法相比。源代码将在\ url {https://supercong94.wixsite.com/supercong94}上获得。

In the field of multimedia, single image deraining is a basic pre-processing work, which can greatly improve the visual effect of subsequent high-level tasks in rainy conditions. In this paper, we propose an effective algorithm, called JDNet, to solve the single image deraining problem and conduct the segmentation and detection task for applications. Specifically, considering the important information on multi-scale features, we propose a Scale-Aggregation module to learn the features with different scales. Simultaneously, Self-Attention module is introduced to match or outperform their convolutional counterparts, which allows the feature aggregation to adapt to each channel. Furthermore, to improve the basic convolutional feature transformation process of Convolutional Neural Networks (CNNs), Self-Calibrated convolution is applied to build long-range spatial and inter-channel dependencies around each spatial location that explicitly expand fields-of-view of each convolutional layer through internal communications and hence enriches the output features. By designing the Scale-Aggregation and Self-Attention modules with Self-Calibrated convolution skillfully, the proposed model has better deraining results both on real-world and synthetic datasets. Extensive experiments are conducted to demonstrate the superiority of our method compared with state-of-the-art methods. The source code will be available at \url{https://supercong94.wixsite.com/supercong94}.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源