论文标题

APT:使用加强学习的自适应基于感知质量的相机调整

APT: Adaptive Perceptual quality based camera Tuning using reinforcement learning

论文作者

Paul, Sibendu, Rao, Kunal, Coviello, Giuseppe, Sankaradas, Murugan, Po, Oliver, Hu, Y. Charlie, Chakradhar, Srimat

论文摘要

摄影机越来越多地在全球的城市,企业和道路上部署,以实现许多在公共安全,智能运输,零售,医疗保健和制造业中的应用。通常,在初步部署相机之后,环境条件和这些相机周围的场景发生了变化,我们的实验表明,这些变化可能会对视频分析中的见解的准确性产生不利影响。这是因为摄像机参数设置虽然在部署时间最佳,但由于在操作过程中的环境条件和场景,因此摄像机捕获的良好视频捕获并不是最佳的设置。捕获质量不佳的视频会不利地影响分析的准确性。为了减轻洞察力准确性的损失,我们提出了一种基于新颖的,加强学习的系统恰当的系统,该系统动态,远程(超过5G网络),调整摄像机参数,以确保捕获高质量的视频捕获,从而减轻视频分析准确性的任何损失。结果,当环境条件或场景内容变化时,这种调整会恢复见解的准确性。 APT使用强化学习,没有引用感知质量估计作为奖励功能。我们进行了广泛的现实实验,在那里我们同时俯瞰着企业停车场的两台摄像头(一台相机仅具有制造商的默认设置,而另一台相机在操作过程中由APT动态调谐)。我们的实验表明,由于APT的动态调整,分析的洞察力在一天中的任何时候都一致地更好:对象检测视频分析应用程序的准确性平均提高了约42%。由于我们的奖励功能独立于任何分析任务,因此可以轻松地用于不同的视频分析任务。

Cameras are increasingly being deployed in cities, enterprises and roads world-wide to enable many applications in public safety, intelligent transportation, retail, healthcare and manufacturing. Often, after initial deployment of the cameras, the environmental conditions and the scenes around these cameras change, and our experiments show that these changes can adversely impact the accuracy of insights from video analytics. This is because the camera parameter settings, though optimal at deployment time, are not the best settings for good-quality video capture as the environmental conditions and scenes around a camera change during operation. Capturing poor-quality video adversely affects the accuracy of analytics. To mitigate the loss in accuracy of insights, we propose a novel, reinforcement-learning based system APT that dynamically, and remotely (over 5G networks), tunes the camera parameters, to ensure a high-quality video capture, which mitigates any loss in accuracy of video analytics. As a result, such tuning restores the accuracy of insights when environmental conditions or scene content change. APT uses reinforcement learning, with no-reference perceptual quality estimation as the reward function. We conducted extensive real-world experiments, where we simultaneously deployed two cameras side-by-side overlooking an enterprise parking lot (one camera only has manufacturer-suggested default setting, while the other camera is dynamically tuned by APT during operation). Our experiments demonstrated that due to dynamic tuning by APT, the analytics insights are consistently better at all times of the day: the accuracy of object detection video analytics application was improved on average by ~ 42%. Since our reward function is independent of any analytics task, APT can be readily used for different video analytics tasks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源