InstaSight: Leveraging AI to See Beyond Sight for Blind Users on Social Media
Chun-Nan Chi,Jia-Lien Hsu,3 Authors,Wei-Chih Juan
TLDR
InstaSight integrates a Single Board Computer, head-mounted webcam, and Bluetooth headset for seamless voice interactions, and fosters social engagement, helping blind users connect and share experiences, improving their psychological well-being.
Abstract
This study introduces “InstaSight,” a system enabling visually impaired individuals to engage with social media focused on visual content. InstaSight integrates a Single Board Computer, head-mounted webcam, and Bluetooth headset for seamless voice interactions. By utilizing the APIs of social media, speech recognition, and Large Language Models (LLMs), users can post photos and videos with voice-to-text captions and listen to comments converted from text or images. This system fosters social engagement, helping blind users connect and share experiences, improving their psychological well-being.
