论文标题
什么是Semeval评估？ NLP评估运动的系统分析
What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP
论文作者
论文摘要
Semeval是NLP社区中提出新挑战和系统的NLP系统经验评估的主要场所。本文对半eval的旨在进行系统的定量分析，以证明Semeval背后的贡献模式。通过了解任务类型，指标，体系结构，参与和引用随着时间的推移的分布，我们旨在回答有关Semeval正在评估的问题的问题。
SemEval is the primary venue in the NLP community for the proposal of new challenges and for the systematic empirical evaluation of NLP systems. This paper provides a systematic quantitative analysis of SemEval aiming to evidence the patterns of the contributions behind SemEval. By understanding the distribution of task types, metrics, architectures, participation and citations over time we aim to answer the question on what is being evaluated by SemEval.
