论文标题
使用强化学习进行智能选择并放置个性化产品
Towards Intelligent Pick and Place Assembly of Individualized Products Using Reinforcement Learning
论文作者
论文摘要
个性化的制造业正在成为一种重要的方法,作为满足日益多样化和特定的消费者需求和期望的一种手段。尽管有各种解决方案来实施制造过程,例如增材制造,但随后的自动组装仍然是一项艰巨的任务。作为解决此问题的一种方法,我们旨在教授协作机器人通过实施强化学习来成功执行和放置任务。为了在不断变化的制造环境中组装个性化产品,模拟的几何和动态参数将有所不同。使用能够元学习的强化学习算法,将首先对任务进行培训。然后,它们将在现实世界环境中进行,其中引入了新的因素,这些因素未在训练中模拟以确认算法的鲁棒性。机器人将从触觉传感器,区域扫描摄像机以及用于生成环境和对象的高度图的3D摄像机中获取其输入数据。机器学习算法和硬件组件的选择以及进一步的研究问题以意识到概述的生产场景,这是提出的工作的结果。
Individualized manufacturing is becoming an important approach as a means to fulfill increasingly diverse and specific consumer requirements and expectations. While there are various solutions to the implementation of the manufacturing process, such as additive manufacturing, the subsequent automated assembly remains a challenging task. As an approach to this problem, we aim to teach a collaborative robot to successfully perform pick and place tasks by implementing reinforcement learning. For the assembly of an individualized product in a constantly changing manufacturing environment, the simulated geometric and dynamic parameters will be varied. Using reinforcement learning algorithms capable of meta-learning, the tasks will first be trained in simulation. They will then be performed in a real-world environment where new factors are introduced that were not simulated in training to confirm the robustness of the algorithms. The robot will gain its input data from tactile sensors, area scan cameras, and 3D cameras used to generate heightmaps of the environment and the objects. The selection of machine learning algorithms and hardware components as well as further research questions to realize the outlined production scenario are the results of the presented work.