论文标题

对共同基础的多模式参考策略的正式分析

A Formal Analysis of Multimodal Referring Strategies Under Common Ground

论文作者

Krishnaswamy, Nikhil, Pustejovsky, James

论文摘要

在本文中,我们介绍了使用手势和语言描述的组合对计算产生的混合模式确定的参考表达式的分析。在此过程中,我们揭示了手势与语言之间相互作用的一些惊人的正式语义特性,其条件是将内容引入(计算)扬声器和(人)观众之间的共同基础,并证明这些形式的特征如何有助于培训更好的模型,以预测参考的表达方式,并有可能对更多自然和信息性推荐的表达方式产生潜在的判断。

In this paper, we present an analysis of computationally generated mixed-modality definite referring expressions using combinations of gesture and linguistic descriptions. In doing so, we expose some striking formal semantic properties of the interactions between gesture and language, conditioned on the introduction of content into the common ground between the (computational) speaker and (human) viewer, and demonstrate how these formal features can contribute to training better models to predict viewer judgment of referring expressions, and potentially to the generation of more natural and informative referring expressions.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源