UPDF AI

"Now I Understand": an application to bridge the gap in communication with hearing impaired people

Karen Baz,Juan Pedro Grille,Cristina Mayr,Gustavo Gretter

2023 · DOI: 10.1109/GHTC56179.2023.10354884
IEEE Global Humanitarian Technology Conference · 0 Citations

Abstract

"Now I Understand" is a mobile application that enables bilateral communication between hearing and non-hearing people using artificial intelligence techniques. The application uses deep learning models to recognize sign language and translate it into text in real-time, while also translating text into sign language. The details of the application implementation are discussed, including data acquisition and preprocessing, selection and training of deep learning models, and the user interface. This application has the potential to revolutionize communication and accessibility for people with hearing impairments by providing a reliable and accurate tool for bilateral communication, as well as improving the general public's awareness and understanding of sign language.