论文标题
平均令牌延迟：同时翻译的延迟度量
Average Token Delay: A Latency Metric for Simultaneous Translation
论文作者
论文摘要
同时翻译是一项任务，在说话者完工之前，翻译开始。在评估中，我们必须考虑翻译的延迟，除了质量。延迟最好是用户尽可能小的延迟来理解说话者所说的话。现有的延迟指标重点介绍了何时开始翻译，但在翻译结束时不充分考虑。这意味着此类指标不会惩罚由长翻译输出引起的延迟，这实际上会延迟用户的理解。在这项工作中，我们提出了一个新型的延迟评估度量，称为“平均代币延迟（ATD）”，该指标的重点是同时翻译中部分翻译的结束时间。我们使用模拟示例讨论了ATD的优势，并通过同时翻译实验研究了ATD和平均滞后之间的差异。
Simultaneous translation is a task in which translation begins before the speaker has finished speaking. In its evaluation, we have to consider the latency of the translation in addition to the quality. The latency is preferably as small as possible for users to comprehend what the speaker says with a small delay. Existing latency metrics focus on when the translation starts but do not consider adequately when the translation ends. This means such metrics do not penalize the latency caused by a long translation output, which actually delays users' comprehension. In this work, we propose a novel latency evaluation metric called Average Token Delay (ATD) that focuses on the end timings of partial translations in simultaneous translation. We discuss the advantage of ATD using simulated examples and also investigate the differences between ATD and Average Lagging with simultaneous translation experiments.
