论文标题
PESAO:主动观察者的心理物理实验设置
PESAO: Psychophysical Experimental Setup for Active Observers
论文作者
论文摘要
计算机视觉中的大多数过去和现在研究都涉及被动观察的数据。但是,人类是实验室外的活跃观察者。他们探索,搜索,选择如何以及如何外观。尽管如此,在人类中如何确切地进行主动观察,以便可以为主动计算机视觉系统的设计提供信息是一个开放的问题。 Pesao旨在研究3D世界中的主动,视觉观察。目的是用人类受试者(活跃的观察者)牢记能够跟踪头部和凝视的各种主题(主动观察者)来建立一个实验设置。尽管许多研究探讨了人类的表现,但通常它们使用2D中描绘的线条图,并且不涉及活跃的观察者。 Pesao允许我们将许多研究带入三维世界,甚至涉及活跃的观察者。在我们的实例化中,它跨越了400厘米x 300厘米的面积,并且可以以120Hz的频率跟踪活跃的观察者。此外,Pesao还提供了6D头运动,凝视,眼动型,第一人称视频,头部安装IMU传感器,鸟眼视频和实验者注释的跟踪和记录。所有这些都以微秒分辨率同步。
Most past and present research in computer vision involves passively observed data. Humans, however, are active observers outside the lab; they explore, search, select what and how to look. Nonetheless, how exactly active observation occurs in humans so that it can inform the design of active computer vision systems is an open problem. PESAO is designed for investigating active, visual observation in a 3D world. The goal was to build an experimental setup for various active perception tasks with human subjects (active observers) in mind that is capable of tracking the head and gaze. While many studies explore human performances, usually, they use line drawings portrayed in 2D, and no active observer is involved. PESAO allows us to bring many studies to the three-dimensional world, even involving active observers. In our instantiation, it spans an area of 400cm x 300cm and can track active observers at a frequency of 120Hz. Furthermore, PESAO provides tracking and recording of 6D head motion, gaze, eye movement-type, first-person video, head-mounted IMU sensor, birds-eye video, and experimenter notes. All are synchronized at microsecond resolution.