论文标题

用于主动对象跟踪的姿势辅助多相机协作

Pose-Assisted Multi-Camera Collaboration for Active Object Tracking

论文作者

Li, Jing, Xu, Jing, Zhong, Fangwei, Kong, Xiangyu, Qiao, Yu, Wang, Yizhou

论文摘要

主动对象跟踪(AOT)对于许多基于视觉的应用程序至关重要,例如移动机器人,智能监视。但是,在复杂场景中部署主动跟踪时存在许多挑战,例如,目标经常被障碍物遮住。在本文中,我们将单相机AOT扩展到多相机设置,在该设置中,相机以协作方式跟踪目标。为了在相机之间实现有效的协作,我们提出了一个新颖的姿势辅助多摄像机协作系统,该系统使摄像头能够通过共享相机姿势进行主动对象跟踪与其他相机合作。在系统中,每个相机都配备了两个控制器和一个切换器:基于视觉的控制器根据观察到的图像跟踪目标。基于姿势的控制器根据其他相机的姿势移动相机。在每个步骤中,切换器都会根据目标的可见性从两个控制器中采取哪些动作。实验结果表明,我们的系统表现优于所有基准,并且能够概括为看不见的环境。代码和演示视频可在我们的网站上获得https://sites.google.com/view/pose-assistedCollaboration。

Active Object Tracking (AOT) is crucial to many visionbased applications, e.g., mobile robot, intelligent surveillance. However, there are a number of challenges when deploying active tracking in complex scenarios, e.g., target is frequently occluded by obstacles. In this paper, we extend the single-camera AOT to a multi-camera setting, where cameras tracking a target in a collaborative fashion. To achieve effective collaboration among cameras, we propose a novel Pose-Assisted Multi-Camera Collaboration System, which enables a camera to cooperate with the others by sharing camera poses for active object tracking. In the system, each camera is equipped with two controllers and a switcher: The vision-based controller tracks targets based on observed images. The pose-based controller moves the camera in accordance to the poses of the other cameras. At each step, the switcher decides which action to take from the two controllers according to the visibility of the target. The experimental results demonstrate that our system outperforms all the baselines and is capable of generalizing to unseen environments. The code and demo videos are available on our website https://sites.google.com/view/pose-assistedcollaboration.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源