论文标题
众包方法用于主观评估回声障碍
Crowdsourcing approach for subjective evaluation of echo impairment
论文作者
论文摘要
通常，使用ERLE和PESQ等客观指标评估了实时通信系统中声音回声癌（AEC）的质量，并且在基于实验室的主观测试（如ITU-T REC）中少见。第831页。我们将证明这些客观措施与主观措施不太相关。然后，我们引入了一种开源众包方法，以主观评估回声障碍，该方法可用于评估AEC的性能。我们提供的研究表明该工具是准确且高度可重现的。最近在ICASSP 2021 AEC挑战中使用了该新工具，这使得挑战成为可能快速和成本的挑战。
The quality of acoustic echo cancellers (AECs) in real-time communication systems is typically evaluated using objective metrics like ERLE and PESQ, and less commonly with lab-based subjective tests like ITU-T Rec. P.831. We will show that these objective measures are not well correlated to subjective measures. We then introduce an open-source crowdsourcing approach for subjective evaluation of echo impairment which can be used to evaluate the performance of AECs. We provide a study that shows this tool is accurate and highly reproducible. This new tool has been recently used in the ICASSP 2021 AEC Challenge which made the challenge possible to do quickly and cost effectively.
