论文标题
使用TensorFlow对象检测API的手语识别系统
Sign Language Recognition System using TensorFlow Object Detection API
论文作者
论文摘要
沟通定义为共享或交换信息,思想或感觉的行为。要在两个人之间建立沟通,他们俩都必须对通用语言有知识和理解。但是,就聋人和愚蠢的人而言,交流手段是不同的。聋人是无法听到的,愚蠢是无法说话的。他们在彼此之间和普通人之间使用手语交流,但普通人并没有认真对待手语的重要性。并非每个人都拥有对手语的知识和理解,这使得普通人与聋人和愚蠢的人之间的沟通困难。为了克服这一障碍,可以基于机器学习建立模型。可以训练模型以识别手语的不同手势并将其翻译成英语。这将帮助许多人与聋人和愚蠢的人进行交流和交谈。现有的印度Sing语言识别系统是使用具有单手和双手手势的机器学习算法设计的,但不是实时的。在本文中,我们提出了一种使用网络摄像头创建印度手语数据集的方法,然后使用传输学习,训练TensorFlow模型创建实时的手语识别系统。即使尺寸有限的数据集,系统也达到了良好的准确性。
Communication is defined as the act of sharing or exchanging information, ideas or feelings. To establish communication between two people, both of them are required to have knowledge and understanding of a common language. But in the case of deaf and dumb people, the means of communication are different. Deaf is the inability to hear and dumb is the inability to speak. They communicate using sign language among themselves and with normal people but normal people do not take seriously the importance of sign language. Not everyone possesses the knowledge and understanding of sign language which makes communication difficult between a normal person and a deaf and dumb person. To overcome this barrier, one can build a model based on machine learning. A model can be trained to recognize different gestures of sign language and translate them into English. This will help a lot of people in communicating and conversing with deaf and dumb people. The existing Indian Sing Language Recognition systems are designed using machine learning algorithms with single and double-handed gestures but they are not real-time. In this paper, we propose a method to create an Indian Sign Language dataset using a webcam and then using transfer learning, train a TensorFlow model to create a real-time Sign Language Recognition system. The system achieves a good level of accuracy even with a limited size dataset.