论文标题
具有短期,情节和语义记忆系统的机器
A Machine with Short-Term, Episodic, and Semantic Memory Systems
论文作者
论文摘要
受到显式人类记忆系统的认知科学理论的启发,我们建模了一种具有短期,情节和语义记忆系统的代理,每个代理都以知识图建模。为了评估该系统并分析该代理的行为,我们设计并发布了自己的强化学习代理环境,“房间”,在该环境中,代理必须学习如何通过回答问题来编码,存储和检索记忆以最大程度地回报。我们表明,基于Q的深度学习代理成功地了解了是否应该忘记短期记忆,或者将其存储在情节或语义记忆系统中。我们的实验表明,具有人类记忆系统的代理可以在环境中没有这种内存结构的情况下胜过代理。
Inspired by the cognitive science theory of the explicit human memory systems, we have modeled an agent with short-term, episodic, and semantic memory systems, each of which is modeled with a knowledge graph. To evaluate this system and analyze the behavior of this agent, we designed and released our own reinforcement learning agent environment, "the Room", where an agent has to learn how to encode, store, and retrieve memories to maximize its return by answering questions. We show that our deep Q-learning based agent successfully learns whether a short-term memory should be forgotten, or rather be stored in the episodic or semantic memory systems. Our experiments indicate that an agent with human-like memory systems can outperform an agent without this memory structure in the environment.