论文标题

熵关联内存

An Entropic Associative Memory

论文作者

Pineda, Luis A., Fuentes, Gibrán, Morales, Rafael

论文摘要

自然记忆是关联的,声明的和分布的。符号计算记忆在声明性特征中类似于自然记忆,并且可以明确存储和恢复信息;但是,它们缺乏自然记忆的关联和分布性特性。连接派或人工神经网络范式中产生的亚符号记忆是关联的和分布的,但无法表达符号结构,并且无法明确存储和获取信息。因此,他们缺乏声明性的财产。为了解决这一难题,我们使用关系性差异计算来建模具有单个对象的分布式表示形式的关联内存寄存器。这种计算模式具有固有的计算熵,可测量表示形式的不确定性。此参数确定内存的操作特征。关联寄存器被嵌入到一个架构中,该体系结构将以模态特异性缓冲区表达的混凝土图像映射到抽象表示中,反之亦然,整体内存系统可以满足自然记忆的三个属性。该系统已用于模拟具有手写数字的表示形式的视觉内存,并且识别和回忆实验表明,有一系列的熵值,不是太低且不太高,其中关联内存寄存器具有令人满意的性能。在内存操作中恢复的提示和对象之间的相似性取决于存储寄存器的熵,保留了相应对象的表示。实验是在模拟中使用标准计算机实现的,但是可以在内存操作采取非常减少的计算步骤的情况下构建并行体系结构。

Natural memories are associative, declarative and distributed. Symbolic computing memories resemble natural memories in their declarative character, and information can be stored and recovered explicitly; however, they lack the associative and distributed properties of natural memories. Sub-symbolic memories developed within the connectionist or artificial neural networks paradigm are associative and distributed, but are unable to express symbolic structure and information cannot be stored and retrieved explicitly; hence, they lack the declarative property. To address this dilemma, we use Relational-Indeterminate Computing to model associative memory registers that hold distributed representations of individual objects. This mode of computing has an intrinsic computing entropy which measures the indeterminacy of representations. This parameter determines the operational characteristics of the memory. Associative registers are embedded in an architecture that maps concrete images expressed in modality-specific buffers into abstract representations, and vice versa, and the memory system as a whole fulfills the three properties of natural memories. The system has been used to model a visual memory holding the representations of hand-written digits, and recognition and recall experiments show that there is a range of entropy values, not too low and not too high, in which associative memory registers have a satisfactory performance. The similarity between the cue and the object recovered in memory retrieve operations depends on the entropy of the memory register holding the representation of the corresponding object. The experiments were implemented in a simulation using a standard computer, but a parallel architecture may be built where the memory operations would take a very reduced number of computing steps.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源