论文标题
傅立叶分解的多模式的先验知识融合用于大脑MRI中红色核分割
Fourier Disentangled Multimodal Prior Knowledge Fusion for Red Nucleus Segmentation in Brain MRI
论文作者
论文摘要
帕金森综合症的早期诊断对于为患者提供适当的护理和纳入治疗试验至关重要。红色核是中脑的结构,在这些疾病中起着重要作用。可以使用对铁敏感的磁共振成像(MRI)序列可视化它。 MRI可以产生不同的铁敏感对比。将这种多模式数据组合起来有可能改善红色核的分割。当前的多模式分割算法在计算上消耗,无法处理缺失的方式,并且需要所有模式的注释。在本文中,我们提出了一个新模型,该模型从不同的对比度中整合了红色核分割的不同对比度。该方法由三个主要阶段组成。首先,它将图像分解为代表大脑结构的高级信息,而低频信息代表对比度。然后将高频信息提供到网络中以学习解剖特征,而多模式低频信息的列表由另一个模块处理。最后,执行功能融合以完成分割任务。所提出的方法与几种铁敏感对比度(Imag,QSM,R2*,SWI)一起使用。实验表明,当训练集大小很小时,我们提出的模型大大优于基线UNET模型。
Early and accurate diagnosis of parkinsonian syndromes is critical to provide appropriate care to patients and for inclusion in therapeutic trials. The red nucleus is a structure of the midbrain that plays an important role in these disorders. It can be visualized using iron-sensitive magnetic resonance imaging (MRI) sequences. Different iron-sensitive contrasts can be produced with MRI. Combining such multimodal data has the potential to improve segmentation of the red nucleus. Current multimodal segmentation algorithms are computationally consuming, cannot deal with missing modalities and need annotations for all modalities. In this paper, we propose a new model that integrates prior knowledge from different contrasts for red nucleus segmentation. The method consists of three main stages. First, it disentangles the image into high-level information representing the brain structure, and low-frequency information representing the contrast. The high-frequency information is then fed into a network to learn anatomical features, while the list of multimodal low-frequency information is processed by another module. Finally, feature fusion is performed to complete the segmentation task. The proposed method was used with several iron-sensitive contrasts (iMag, QSM, R2*, SWI). Experiments demonstrate that our proposed model substantially outperforms a baseline UNet model when the training set size is very small.