Augmented Reality for Learning Sign Language Using Kinect Tool

Resultado de la investigación: Capítulo del libro/informe/acta de congresoContribución de conferenciarevisión exhaustiva

Resumen

The use of Augmented Reality (AR) has increased markedly as an educational tool due to the implementation of smart devices (PCs, smartphones or tablets), that complement the interaction with the real world, allowing a better perception of the environment for people with hearing impairment by the additional information it generates. This article focuses on developing a low-cost functional application that is interactive and easy to manipulate for people with hearing disabilities or people who work or socialize with them, with the aim of facilitating the process of learning sign language. The implementation was carried out using Augmented Reality along with the Kinect V2 device, due to the fidelity of the depth camera and RGB camera, which enable the design of the learning and evaluation process using Unity software. Finally, the results obtained by carrying out the experimental method and performing the application’s operational tests for prototype validation are presented, achieving a gesture recognition accuracy of 90%. In this way, a reinforcement and complement is allowed in the learning of Ecuadorian sign language in an interactive way, providing an improvement in the quality of life of people with hearing impairment.

Idioma originalInglés
Título de la publicación alojadaDevelopments and Advances in Defense and Security - Proceedings of MICRADS 2021
EditoresÁlvaro Rocha, Carlos Hernan Fajardo-Toro, José María Riola Rodríguez
EditorialSpringer Science and Business Media Deutschland GmbH
Páginas447-457
Número de páginas11
ISBN (versión impresa)9789811648830
DOI
EstadoPublicada - 2022
EventoMultidisciplinary International Conference of Research Applied to Defense and Security, MICRADS 2021 - Cartagena, Colombia
Duración: 18 ago. 202120 ago. 2021

Serie de la publicación

NombreSmart Innovation, Systems and Technologies
Volumen255
ISSN (versión impresa)2190-3018
ISSN (versión digital)2190-3026

Conferencia

ConferenciaMultidisciplinary International Conference of Research Applied to Defense and Security, MICRADS 2021
País/TerritorioColombia
CiudadCartagena
Período18/08/2120/08/21

Nota bibliográfica

Publisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

Huella

Profundice en los temas de investigación de 'Augmented Reality for Learning Sign Language Using Kinect Tool'. En conjunto forman una huella única.

Citar esto