论文标题
使用暹罗多任务CNN从面部图像中学习基于偏好的相似性
Learning Preference-Based Similarities from Face Images using Siamese Multi-Task CNNs
论文作者
论文摘要
在过去的几十年中,在线约会已成为普遍的情况。在线约会平台的主要挑战是确定适合其用户的匹配。许多约会服务都依赖于自我报告的用户特征和偏好进行匹配。同时,某些服务在很大程度上依赖用户图像,从而初始视觉偏好。特别是对于后一种方法,以前的研究试图捕获用户的视觉偏好以进行自动匹配推荐。这些方法主要基于以下假设:物理吸引是关系形成和个人偏好,兴趣和态度的关键因素。深度学习方法表明,可以从人的面孔中预测各种特性,包括年龄,健康甚至人格特征。因此,我们研究了基于图像的匹配和与个人兴趣,偏好和态度匹配的可行性。我们仅根据面部的图像来预测两个用户之间的相似性得分,以监督的方式解决问题。相似性匹配分数的基础真相由旨在捕获用户的偏好,兴趣和态度的测试确定,这些测试与形成浪漫关系有关。这些图像由暹罗多任务深度学习架构处理。我们发现预测和目标相似性得分之间具有统计学意义的相关性。因此,我们的结果表明,从兴趣,偏好和面部图像的态度方面学习相似性似乎在某种程度上是可行的。
Online dating has become a common occurrence over the last few decades. A key challenge for online dating platforms is to determine suitable matches for their users. A lot of dating services rely on self-reported user traits and preferences for matching. At the same time, some services largely rely on user images and thus initial visual preference. Especially for the latter approach, previous research has attempted to capture users' visual preferences for automatic match recommendation. These approaches are mostly based on the assumption that physical attraction is the key factor for relationship formation and personal preferences, interests, and attitude are largely neglected. Deep learning approaches have shown that a variety of properties can be predicted from human faces to some degree, including age, health and even personality traits. Therefore, we investigate the feasibility of bridging image-based matching and matching with personal interests, preferences, and attitude. We approach the problem in a supervised manner by predicting similarity scores between two users based on images of their faces only. The ground-truth for the similarity matching scores is determined by a test that aims to capture users' preferences, interests, and attitude that are relevant for forming romantic relationships. The images are processed by a Siamese Multi-Task deep learning architecture. We find a statistically significant correlation between predicted and target similarity scores. Thus, our results indicate that learning similarities in terms of interests, preferences, and attitude from face images appears to be feasible to some degree.