论文标题
使用完全卷积的空间传播网络,高光谱图像分类具有空间一致性
Hyperspectral Image Classification with Spatial Consistence Using Fully Convolutional Spatial Propagation Network
论文作者
论文摘要
近年来,深度卷积神经网络(CNN)表现出令人印象深刻的表示高光谱图像(HSIS)的能力,并在HSI分类中取得了令人鼓舞的结果。但是,现有的基于CNN的模型在补丁级上运行,其中像素分别使用周围的图像分别分类为类。该补丁级分类将导致大量重复计算,并且很难确定有益于分类精度的适当贴片大小。此外,常规的CNN模型还通过局部接受场进行卷积,这在对上下文空间信息进行建模时会导致失败。为了克服上述局限性,我们提出了一种新颖的端到端,像素到像素完全卷积的空间传播网络(FCSPN)进行HSI分类。我们的FCSPN由3D完全卷积网络(3D-FCN)和一个卷积的空间传播网络(CSPN)组成。具体而言,首先引入了3D-FCN,以进行可靠的初步分类,其中提出了一种新型的双重可分离残差(DSR)单元,以在较少的参数中同时有效捕获光谱和空间信息。此外,通过频道的注意机制在3D-FCN中进行了调整,以从冗余通道信息中掌握最有用的渠道。最后,引入CSPN来通过学习局部线性空间传播来捕获HSI的空间相关性,从而可以维持HSI空间一致性并进一步完善分类结果。三个HSI基准数据集的实验结果表明,所提出的FCSPN在HSI分类方面实现了最先进的性能。
In recent years, deep convolutional neural networks (CNNs) have shown impressive ability to represent hyperspectral images (HSIs) and achieved encouraging results in HSI classification. However, the existing CNN-based models operate at the patch-level, in which pixel is separately classified into classes using a patch of images around it. This patch-level classification will lead to a large number of repeated calculations, and it is difficult to determine the appropriate patch size that is beneficial to classification accuracy. In addition, the conventional CNN models operate convolutions with local receptive fields, which cause failures in modeling contextual spatial information. To overcome the aforementioned limitations, we propose a novel end-to-end, pixels-to-pixels fully convolutional spatial propagation network (FCSPN) for HSI classification. Our FCSPN consists of a 3D fully convolution network (3D-FCN) and a convolutional spatial propagation network (CSPN). Specifically, the 3D-FCN is firstly introduced for reliable preliminary classification, in which a novel dual separable residual (DSR) unit is proposed to effectively capture spectral and spatial information simultaneously with fewer parameters. Moreover, the channel-wise attention mechanism is adapted in the 3D-FCN to grasp the most informative channels from redundant channel information. Finally, the CSPN is introduced to capture the spatial correlations of HSI via learning a local linear spatial propagation, which allows maintaining the HSI spatial consistency and further refining the classification results. Experimental results on three HSI benchmark datasets demonstrate that the proposed FCSPN achieves state-of-the-art performance on HSI classification.