论文标题
在仪表板视频中进行异常检测
Towards Anomaly Detection in Dashcam Videos
论文作者
论文摘要
廉价的传感和计算以及保险创新使智能仪表板相机无处不在。越来越多的简单模型驱动的计算机视觉算法着重于车道偏离或安全后的距离,正在进入这些设备。不幸的是,道路危害的长尾分配意味着这些手工制作的管道不足以用于驾驶员安全系统。我们建议将以数据驱动的异常检测想法从深度学习到仪表板视频进行,这有望弥合这一差距。不幸的是,几乎没有文献应用于移动相机的异常理解,并且相应地缺乏相关数据集。为了解决这个问题,我们介绍了卡车仪表板视频的大量而多样的数据集,即Retrotrucks,其中包括正常和异常的驾驶场景。我们申请:(i)一级分类损失和(ii)基于重建的损失,用于在逆转录电池以及现有的静态相机数据集上的异常检测。我们介绍了在此上下文中作为先验的对象相互作用建模的公式。我们的实验表明,我们的数据集确实比标准异常检测数据集更具挑战性,并且以前的异常检测方法在此范围内表现不佳。此外,我们分享了这两个重要的仪表板数据中检测方法的行为的见解。
Inexpensive sensing and computation, as well as insurance innovations, have made smart dashboard cameras ubiquitous. Increasingly, simple model-driven computer vision algorithms focused on lane departures or safe following distances are finding their way into these devices. Unfortunately, the long-tailed distribution of road hazards means that these hand-crafted pipelines are inadequate for driver safety systems. We propose to apply data-driven anomaly detection ideas from deep learning to dashcam videos, which hold the promise of bridging this gap. Unfortunately, there exists almost no literature applying anomaly understanding to moving cameras, and correspondingly there is also a lack of relevant datasets. To counter this issue, we present a large and diverse dataset of truck dashcam videos, namely RetroTrucks, that includes normal and anomalous driving scenes. We apply: (i) one-class classification loss and (ii) reconstruction-based loss, for anomaly detection on RetroTrucks as well as on existing static-camera datasets. We introduce formulations for modeling object interactions in this context as priors. Our experiments indicate that our dataset is indeed more challenging than standard anomaly detection datasets, and previous anomaly detection methods do not perform well here out-of-the-box. In addition, we share insights into the behavior of these two important families of anomaly detection approaches on dashcam data.