ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the Wild
W4A 2024, Talk
Authors:
Andi Xu, Minyu Cai, Dier Hou, Ruei-Che Chang, Anhong Guo
Abstract:
Blind and visually-impaired (BVI) users often rely on alt-texts to understand images. AI-generated alt-texts can be scalable and efficient but may lack details and are prone to errors. Multi-layered touch interfaces, on the other hand, can provide rich details and spatial information, but may take longer to explore and cause higher mental load. To understand how BVI users leverage these two methods, we deployed ImageExplorer, an iOS app on the Apple App Store that provides multi-layered image information via both text-based and touch-based interfaces with customizable levels of granularity. Across 12 months, 371 users uploaded 651 images and explored 694 times. Their activities were logged to help us understand how BVI users consume image captions in the wild. This work informs a holistic understanding of BVI users' image exploration behavior and influential factors. We provide design implications for future models of image captioning and visual access tools.
Paper available at: https://guoanhong.com/papers/W4A2024-...
The ImageExplorer app is publicly available at: https://imageexplorer.org/
Watch video ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the Wild online without registration, duration hours minute second in high quality. This video was added by user Anhong Guo 26 May 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 43 once and liked it 1 people.