The use of Augmented Reality (AR) has increased markedly as an educational tool due to the implementation of smart devices (PCs, smartphones or tablets), that complement the interaction with the real world, allowing a better perception of the environment for people with hearing impairment by the additional information it generates. This article focuses on developing a low-cost functional application that is interactive and easy to manipulate for people with hearing disabilities or people who work or socialize with them, with the aim of facilitating the process of learning sign language. The implementation was carried out using Augmented Reality along with the Kinect V2 device, due to the fidelity of the depth camera and RGB camera, which enable the design of the learning and evaluation process using Unity software. Finally, the results obtained by carrying out the experimental method and performing the application’s operational tests for prototype validation are presented, achieving a gesture recognition accuracy of 90%. In this way, a reinforcement and complement is allowed in the learning of Ecuadorian sign language in an interactive way, providing an improvement in the quality of life of people with hearing impairment.
|Title of host publication||Developments and Advances in Defense and Security - Proceedings of MICRADS 2021|
|Editors||Álvaro Rocha, Carlos Hernan Fajardo-Toro, José María Riola Rodríguez|
|Publisher||Springer Science and Business Media Deutschland GmbH|
|Number of pages||11|
|State||Published - 2022|
|Event||Multidisciplinary International Conference of Research Applied to Defense and Security, MICRADS 2021 - Cartagena, Colombia|
Duration: 18 Aug 2021 → 20 Aug 2021
|Name||Smart Innovation, Systems and Technologies|
|Conference||Multidisciplinary International Conference of Research Applied to Defense and Security, MICRADS 2021|
|Period||18/08/21 → 20/08/21|
Bibliographical notePublisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
- Augmented Reality
- Hearing impairment
- Sign language