Resumen
Nowadays, the automatic detection of objects, either in images or in videos are topics of high interest in the development of technologies related to the deep learning approach, one of them is the field of forensic acoustics. Forensic acoustics is related to a security approach where the technology is used to try resolve policies’ issues. In this work, considering that Generative Adversarial Networks (GANs) have been used successfully in the reconstruction or generation images, the recognition of the face of people from its audio or video recordings has been studied using GANs. Due the novelty of this research, there are not many databases to evaluate the goodness of the models, so, an images-audio database has been created, containing both, images and audio of people who appear in videos of the YouTube platform. These images and corresponding audio embeddings have been used to train the proposed models based on GANs. The objective of this work is to generate the image of the face of a person considering only its audio voice signal as feature, that is, generate a face like the owner of the voice. The metric used to evaluate the efficiency of the proposed technique has been the “Peak Signal to Noise Ratio” metric (PSNR) which is able to determine if an image could be considered as a human face. Up to 28.39 dB of PSNR has been obtained when the images generated from its voice embeddings were evaluated, presenting up to 30% of relative improvement comparing to the same technique that use noise as feature.
Idioma original | Inglés |
---|---|
Título de la publicación alojada | Intelligent Computing - Proceedings of the 2023 Computing Conference |
Editores | Kohei Arai |
Editorial | Springer Science and Business Media Deutschland GmbH |
Páginas | 262-273 |
Número de páginas | 12 |
ISBN (versión impresa) | 9783031377167 |
DOI | |
Estado | Publicada - 2023 |
Evento | Proceedings of the Computing Conference 2023 - London, Reino Unido Duración: 22 jun. 2023 → 23 jun. 2023 |
Serie de la publicación
Nombre | Lecture Notes in Networks and Systems |
---|---|
Volumen | 711 LNNS |
ISSN (versión impresa) | 2367-3370 |
ISSN (versión digital) | 2367-3389 |
Conferencia
Conferencia | Proceedings of the Computing Conference 2023 |
---|---|
País/Territorio | Reino Unido |
Ciudad | London |
Período | 22/06/23 → 23/06/23 |
Nota bibliográfica
Publisher Copyright:© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.