论文标题

使用最佳运输损失和单峰输出概率的深度序数回归

Deep Ordinal Regression using Optimal Transport Loss and Unimodal Output Probabilities

论文作者

Shaham, Uri, Zaidman, Igal, Svirsky, Jonathan

论文摘要

通常需要序数回归模型产生单峰预测。但是,在最近的许多作品中,这种特征是不存在的,要么是使用软目标实施的,这不能保证推断时单型输出。此外,我们认为标准最大似然目标不适合序数回归问题,并且最佳运输更适合此任务,因为它自然会捕获类的顺序。在这项工作中,我们基于单峰输出分布和最佳运输损失,为深度序列回归提出了一个框架。受到众所周知的比例赔率模型的启发,我们建议通过使用一种建筑机制来修改其设计,该机制确保模型输出分布将是单峰。我们经验分析了我们提出的方法的不同组成部分,并证明了它们对模型性能的贡献。八个现实世界数据集的实验结果表明,我们所提出的方法始终如一地表现,并且通常比最近提出的具有单峰输出概率的深度序数回归方法更好,同时保证了输出单峰。此外,我们证明所提出的方法比目前的基线不太自信。

It is often desired that ordinal regression models yield unimodal predictions. However, in many recent works this characteristic is either absent, or implemented using soft targets, which do not guarantee unimodal outputs at inference. In addition, we argue that the standard maximum likelihood objective is not suitable for ordinal regression problems, and that optimal transport is better suited for this task, as it naturally captures the order of the classes. In this work, we propose a framework for deep ordinal regression, based on unimodal output distribution and optimal transport loss. Inspired by the well-known Proportional Odds model, we propose to modify its design by using an architectural mechanism which guarantees that the model output distribution will be unimodal. We empirically analyze the different components of our proposed approach and demonstrate their contribution to the performance of the model. Experimental results on eight real-world datasets demonstrate that our proposed approach consistently performs on par with and often better than several recently proposed deep learning approaches for deep ordinal regression with unimodal output probabilities, while having guarantee on the output unimodality. In addition, we demonstrate that proposed approach is less overconfident than current baselines.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源