论文标题
UFNREC:利用假阴性样本进行顺序建议
UFNRec: Utilizing False Negative Samples for Sequential Recommendation
论文作者
论文摘要
顺序建议模型主要是优化的,以区分训练中的阳性样本和阴性样本,在训练中,负抽样是通过历史记录学习不断发展的用户偏好的重要组成部分。除了从均匀分布的子集中随机采样负样品外,已经提出了许多精致的方法来开采高质量的负样品。但是,由于阴性采样的固有随机性,假阴性样品不可避免地在模型训练中收集。当前的策略主要集中于消除这种假阴性样本,这会导致忽视潜在的用户利益,缺乏建议多样性,较少的模型鲁棒性以及遭受暴露偏见的困扰。为此,我们提出了一种新的方法,可以利用假阴性样本进行顺序推荐(UFNREC)来提高模型性能。我们首先设计了一种简单的策略来提取假阴性样本,然后在以下训练过程中将这些样品转移到正样本中。此外,我们构建了一个教师模型,以为假阴性样本提供软标签,并设计一致性损失,以使学生模型和教师模型对这些样本的预测进行正规化。据我们所知,这是第一项利用假阴性样本,而不是简单地将其删除以进行顺序建议。使用三种广泛应用的SOTA模型进行了三个基准公共数据集的实验。实验结果表明,我们提出的UFNREC可以有效地从假阴性样本中汲取信息,并进一步改善SOTA模型的性能。该代码可在https://github.com/ufnrec-code/ufnrec上找到。
Sequential recommendation models are primarily optimized to distinguish positive samples from negative ones during training in which negative sampling serves as an essential component in learning the evolving user preferences through historical records. Except for randomly sampling negative samples from a uniformly distributed subset, many delicate methods have been proposed to mine negative samples with high quality. However, due to the inherent randomness of negative sampling, false negative samples are inevitably collected in model training. Current strategies mainly focus on removing such false negative samples, which leads to overlooking potential user interests, lack of recommendation diversity, less model robustness, and suffering from exposure bias. To this end, we propose a novel method that can Utilize False Negative samples for sequential Recommendation (UFNRec) to improve model performance. We first devise a simple strategy to extract false negative samples and then transfer these samples to positive samples in the following training process. Furthermore, we construct a teacher model to provide soft labels for false negative samples and design a consistency loss to regularize the predictions of these samples from the student model and the teacher model. To the best of our knowledge, this is the first work to utilize false negative samples instead of simply removing them for the sequential recommendation. Experiments on three benchmark public datasets are conducted using three widely applied SOTA models. The experiment results demonstrate that our proposed UFNRec can effectively draw information from false negative samples and further improve the performance of SOTA models. The code is available at https://github.com/UFNRec-code/UFNRec.