论文标题
深度学习从卫星图像衍生的点云中的引导建筑重建
Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds
论文作者
论文摘要
在过去的二十年中,从遥感的图像中对建筑物进行建筑物的3D城市重建引起了极大的关注。虽然天线图像和激光雷达提供更高的分辨率,但卫星图像更便宜,更有效地满足了大规模需求。然而,卫星观察的高,轨道高度带来了内在的挑战,例如不可预测的大气效应,多视图角度,由于必要的多重视图,场景中的各种土地覆盖率和城市结构,较小的基础高度比率或狭窄的视野,各种视野可能会降级3D重新构造质量。为了应对这些主要挑战,我们提出了一种可靠有效的方法,可以从多视图卫星图像产生的点云中构建模型重建。我们利用多种类型的原始形状来适合输入点云。具体而言,采用了深入学习的方法来区分复杂但嘈杂的场景中建筑屋顶的形状。对于属于同一屋顶形状的点,提出了一种多提示的分层RANSAC方法,以进行有效且可靠的分段和重建建筑物点云。在四个选定的城市区域(0.34至2.04平方公里的大小)上的实验结果表明,所提出的方法可以在嘈杂的数据环境下生成详细的屋顶结构。构建形状识别的平均成功率为83.0%,而与机载LiDAR产生的地面真相有关,总体完整性和正确性超过70%。作为满足大规模城市模型生成需求的首次努力,该开发被部署为开源软件。
3D urban reconstruction of buildings from remotely sensed imagery has drawn significant attention during the past two decades. While aerial imagery and LiDAR provide higher resolution, satellite imagery is cheaper and more efficient to acquire for large scale need. However, the high, orbital altitude of satellite observation brings intrinsic challenges, like unpredictable atmospheric effect, multi view angles, significant radiometric differences due to the necessary multiple views, diverse land covers and urban structures in a scene, small base-height ratio or narrow field of view, all of which may degrade 3D reconstruction quality. To address these major challenges, we present a reliable and effective approach for building model reconstruction from the point clouds generated from multi-view satellite images. We utilize multiple types of primitive shapes to fit the input point cloud. Specifically, a deep-learning approach is adopted to distinguish the shape of building roofs in complex and yet noisy scenes. For points that belong to the same roof shape, a multi-cue, hierarchical RANSAC approach is proposed for efficient and reliable segmenting and reconstructing the building point cloud. Experimental results over four selected urban areas (0.34 to 2.04 sq km in size) demonstrate the proposed method can generate detailed roof structures under noisy data environments. The average successful rate for building shape recognition is 83.0%, while the overall completeness and correctness are over 70% with reference to ground truth created from airborne lidar. As the first effort to address the public need of large scale city model generation, the development is deployed as open source software.