Augmented Reality for Learning Sign Language Using Kinect Tool

Resultado de la investigación: Capítulo del libro/informe/acta de congresoContribución de conferenciarevisión exhaustiva


The use of Augmented Reality (AR) has increased markedly as an educational tool due to the implementation of smart devices (PCs, smartphones or tablets), that complement the interaction with the real world, allowing a better perception of the environment for people with hearing impairment by the additional information it generates. This article focuses on developing a low-cost functional application that is interactive and easy to manipulate for people with hearing disabilities or people who work or socialize with them, with the aim of facilitating the process of learning sign language. The implementation was carried out using Augmented Reality along with the Kinect V2 device, due to the fidelity of the depth camera and RGB camera, which enable the design of the learning and evaluation process using Unity software. Finally, the results obtained by carrying out the experimental method and performing the application’s operational tests for prototype validation are presented, achieving a gesture recognition accuracy of 90%. In this way, a reinforcement and complement is allowed in the learning of Ecuadorian sign language in an interactive way, providing an improvement in the quality of life of people with hearing impairment.

Idioma originalInglés
Título de la publicación alojadaDevelopments and Advances in Defense and Security - Proceedings of MICRADS 2021
EditoresÁlvaro Rocha, Carlos Hernan Fajardo-Toro, José María Riola Rodríguez
EditorialSpringer Science and Business Media Deutschland GmbH
Número de páginas11
ISBN (versión impresa)9789811648830
EstadoPublicada - 2022
EventoMultidisciplinary International Conference of Research Applied to Defense and Security, MICRADS 2021 - Cartagena, Colombia
Duración: 18 ago. 202120 ago. 2021

Serie de la publicación

NombreSmart Innovation, Systems and Technologies
ISSN (versión impresa)2190-3018
ISSN (versión digital)2190-3026


ConferenciaMultidisciplinary International Conference of Research Applied to Defense and Security, MICRADS 2021

Nota bibliográfica

Publisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.


Profundice en los temas de investigación de 'Augmented Reality for Learning Sign Language Using Kinect Tool'. En conjunto forman una huella única.

Citar esto