论文标题
使用物理受限的深度学习,基于多模式成像的材料质量密度估计
Multimodal Imaging-based Material Mass Density Estimation for Proton Therapy Using Physics-Constrained Deep Learning
论文作者
论文摘要
将计算机断层扫描(CT)的映射到材料属性主导质子范围的不确定性。这项工作旨在开发一个基于物理的深度学习多模式成像(PDMI)框架,以整合物理,深度学习,磁共振成像(MRI)和高级双能量CT(DECT),以得出准确的患者质量密度图。七个组织替代MRI幻像用于基于PDMI的材料校准。训练输入来自MRI和双光束双能图像,并在120 kVp的带有黄金和锡过滤器的情况下获取。可行性调查包括经验DECT相关性和四个剩余网络(RESNET),这些网络(RESNET)源自PDMI框架的不同培训输入和策略。 PRN-MR-DE和RN-MR-DE表示使用MRI和DECT图像进行物理约束的重新网络。 PRN-DE和RN-DE表示使用仅使用DECT图像的物理约束的重新NET。对于组织替代研究,PRN-MR-DE,PRN-DE和RN-MR-DE导致平均质量密度误差:脂肪的-0.72%,2.62%,-3.58%; -0.03%,-0.61%和-0.18%的肌肉; -0.58%,-1.36%和-4.86%的45%ha骨。回顾性患者研究表明,PRN-MR-DE根据文献调查预测了预期间隔内软组织和骨骼的密度,而PRN-DE产生了较大的密度偏差。提出的PDMI框架可以使用MRI和DECT图像生成准确的质量密度图。物理受限的训练可以进一步增强模型功效,从而使PRN-MR-DE的表现优于RN-MR-DE。患者的研究还表明,PDMI框架有可能通过精确的患者质量密度图改善质子范围的不确定性。
Mapping computed tomography (CT) number to material property dominates the proton range uncertainty. This work aims to develop a physics-constrained deep learning-based multimodal imaging (PDMI) framework to integrate physics, deep learning, magnetic resonance imaging (MRI), and advanced dual-energy CT (DECT) to derive accurate patient mass density maps. Seven tissue substitute MRI phantoms were used for PDMI-based material calibration. The training inputs are from MRI and twin-beam dual-energy images acquired at 120 kVp with gold and tin filters. The feasibility investigation included an empirical DECT correlation and four residual networks (ResNet) derived from different training inputs and strategies by the PDMI framework. PRN-MR-DE and RN-MR-DE denote ResNet trained with and without a physics constraint using MRI and DECT images. PRN-DE and RN-DE represent ResNet trained with and without a physics constraint using DECT-only images. For the tissue surrogate study, PRN-MR-DE, PRN-DE, and RN-MR-DE result in mean mass density errors: -0.72%, 2.62%, -3.58% for adipose; -0.03%, -0.61%, and -0.18% for muscle; -0.58%, -1.36%, and -4.86% for 45% HA bone. The retrospective patient study indicated that PRN-MR-DE predicted the densities of soft tissue and bone within expected intervals based on the literature survey, while PRN-DE generated large density deviations. The proposed PDMI framework can generate accurate mass density maps using MRI and DECT images. The physics-constrained training can further enhance model efficacy, making PRN-MR-DE outperform RN-MR-DE. The patient investigation also shows that the PDMI framework has the potential to improve proton range uncertainty with accurate patient mass density maps.