论文标题
M-SENA:多模式分析的集成平台
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis
论文作者
论文摘要
M-Sena是一个开源的多模式分析平台。它旨在通过提供灵活的工具包,可靠的基准和直观的演示来促进先进的研究。该平台具有一个完全模块化的视频情感分析框架,该框架包括数据管理,功能提取,模型培训和结果分析模块。在本文中,我们首先说明M-Sena平台的整体体系结构,然后介绍核心模块的功能。还报道了不同模态特征和MSA基准测试的可靠基线结果。此外,我们使用M-SENA提供的模型评估和分析工具来介绍中间表示可视化,即时实例测试和通用能力测试结果。该平台的源代码可在https://github.com/thuiar/m-sena上公开获得。
M-SENA is an open-sourced platform for Multimodal Sentiment Analysis. It aims to facilitate advanced research by providing flexible toolkits, reliable benchmarks, and intuitive demonstrations. The platform features a fully modular video sentiment analysis framework consisting of data management, feature extraction, model training, and result analysis modules. In this paper, we first illustrate the overall architecture of the M-SENA platform and then introduce features of the core modules. Reliable baseline results of different modality features and MSA benchmarks are also reported. Moreover, we use model evaluation and analysis tools provided by M-SENA to present intermediate representation visualization, on-the-fly instance test, and generalization ability test results. The source code of the platform is publicly available at https://github.com/thuiar/M-SENA.