论文标题
从多模式和多阶段地球观察数据中学习,用于建筑损害映射
Learning from Multimodal and Multitemporal Earth Observation Data for Building Damage Mapping
论文作者
论文摘要
地球观测技术,例如光学成像和合成孔径雷达(SAR),为不断监视不断增长的城市环境提供了出色的手段。值得注意的是,在大规模灾难(例如海啸和地震)的情况下,响应是高度关键的,这两种数据方式的图像都可以相互补充,以准确传达灾难后的全部损害条件。但是,由于天气和卫星覆盖范围等几个因素,通常不确定哪种数据模式将是第一个用于快速灾难响应工作的方法。因此,可以利用所有可访问的EO数据集的新方法对于灾难管理至关重要。在这项研究中,我们开发了一个用于构建损坏映射的全球多传感器和多阶段数据集。我们包括三种灾难类型的建筑损害特征,即地震,海啸和台风,并考虑了三个建筑损害类别。全局数据集包含高分辨率的光学图像和每次灾难之前和之后获取的高分辨率多键SAR数据。使用此综合数据集,我们分析了五个数据模式方案,以进行损坏映射:单模(光学和SAR数据集),跨模式(前模式光学和后式光盘和后式SAR数据集)和模式融合场景。我们为基于深层卷积神经网络算法的受损建筑物的语义分割定义了损坏映射框架。我们将我们的方法比较了另一个最先进的基线模型以进行损坏映射。结果表明,我们的数据集与深度学习网络一起启用了所有数据模式方案的可接受预测。
Earth observation technologies, such as optical imaging and synthetic aperture radar (SAR), provide excellent means to monitor ever-growing urban environments continuously. Notably, in the case of large-scale disasters (e.g., tsunamis and earthquakes), in which a response is highly time-critical, images from both data modalities can complement each other to accurately convey the full damage condition in the disaster's aftermath. However, due to several factors, such as weather and satellite coverage, it is often uncertain which data modality will be the first available for rapid disaster response efforts. Hence, novel methodologies that can utilize all accessible EO datasets are essential for disaster management. In this study, we have developed a global multisensor and multitemporal dataset for building damage mapping. We included building damage characteristics from three disaster types, namely, earthquakes, tsunamis, and typhoons, and considered three building damage categories. The global dataset contains high-resolution optical imagery and high-to-moderate-resolution multiband SAR data acquired before and after each disaster. Using this comprehensive dataset, we analyzed five data modality scenarios for damage mapping: single-mode (optical and SAR datasets), cross-modal (pre-disaster optical and post-disaster SAR datasets), and mode fusion scenarios. We defined a damage mapping framework for the semantic segmentation of damaged buildings based on a deep convolutional neural network algorithm. We compare our approach to another state-of-the-art baseline model for damage mapping. The results indicated that our dataset, together with a deep learning network, enabled acceptable predictions for all the data modality scenarios.