论文标题
在第四ABAW挑战中的合成图像中手工辅助表达识别方法
Hand-Assisted Expression Recognition Method from Synthetic Images at the Fourth ABAW Challenge
论文作者
论文摘要
从合成图像中学习由于标记真实图像的困难而在面部表达识别任务中起着重要作用，并且由于合成图像和真实图像之间的差距而具有挑战性。第四次情感行为分析在野外竞争提高了挑战，并提供了Aff-Wild2数据集产生的合成图像。在本文中，我们提出了一种手工辅助表达识别方法，以减少合成数据和真实数据之间的差距。我们的方法由两个部分组成：表达识别模块和手部预测模块。表达识别模块提取表达信息，并预测模块预测图像是否包含手。决策模式用于结合两个模块的结果，并使用后固定来改善结果。 F1分数用于验证我们方法的有效性。
Learning from synthetic images plays an important role in facial expression recognition task due to the difficulties of labeling the real images, and it is challenging because of the gap between the synthetic images and real images. The fourth Affective Behavior Analysis in-the-wild Competition raises the challenge and provides the synthetic images generated from Aff-Wild2 dataset. In this paper, we propose a hand-assisted expression recognition method to reduce the gap between the synthetic data and real data. Our method consists of two parts: expression recognition module and hand prediction module. Expression recognition module extracts expression information and hand prediction module predicts whether the image contains hands. Decision mode is used to combine the results of two modules, and post-pruning is used to improve the result. F1 score is used to verify the effectiveness of our method.
