论文标题

在线多对象跟踪的统一对象运动和亲和力模型

A Unified Object Motion and Affinity Model for Online Multi-Object Tracking

论文作者

Yin, Junbo, Wang, Wenguan, Meng, Qinghao, Yang, Ruigang, Shen, Jianbing

论文摘要

当前流行的在线多对象跟踪(MOT)解决方案应用单个对象跟踪器(SOT)来捕获对象运动,同时通常需要一个额外的亲和力网络来关联对象,尤其是对于遮挡的对象。由于SOT和亲和力计算的重复性特征提取,这带来了额外的计算开销。同时,复杂的亲和力网络的模型大小通常是不平凡的。在本文中,我们提出了一个新颖的MOT框架,该框架将对象运动和亲和力模型统一到一个名为UMA的网络中,以学习一个紧凑的功能,该功能既可以歧视对象运动和亲和力度量。特别是,UMA通过多任务学习将单个对象跟踪和度量学习集成到统一的三胞胎网络中。这种设计带来了提高计算效率,低内存要求和简化训练程序的优势。此外,我们为模型配备了特定于任务的注意模块,该模块用于增强任务感知功能学习。提出的uma可以很容易地端对端训练,而且优雅 - 只需要一个训练阶段。实验结果表明,它在几个MOT挑战基准上实现了有希望的表现。

Current popular online multi-object tracking (MOT) solutions apply single object trackers (SOTs) to capture object motions, while often requiring an extra affinity network to associate objects, especially for the occluded ones. This brings extra computational overhead due to repetitive feature extraction for SOT and affinity computation. Meanwhile, the model size of the sophisticated affinity network is usually non-trivial. In this paper, we propose a novel MOT framework that unifies object motion and affinity model into a single network, named UMA, in order to learn a compact feature that is discriminative for both object motion and affinity measure. In particular, UMA integrates single object tracking and metric learning into a unified triplet network by means of multi-task learning. Such design brings advantages of improved computation efficiency, low memory requirement and simplified training procedure. In addition, we equip our model with a task-specific attention module, which is used to boost task-aware feature learning. The proposed UMA can be easily trained end-to-end, and is elegant - requiring only one training stage. Experimental results show that it achieves promising performance on several MOT Challenge benchmarks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源