ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the Wild

Опубликовано: 26 Май 2024
на канале: Anhong Guo
43
1

ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the Wild

W4A 2024, Talk

Authors:
Andi Xu, Minyu Cai, Dier Hou, Ruei-Che Chang, Anhong Guo

Abstract:
Blind and visually-impaired (BVI) users often rely on alt-texts to understand images. AI-generated alt-texts can be scalable and efficient but may lack details and are prone to errors. Multi-layered touch interfaces, on the other hand, can provide rich details and spatial information, but may take longer to explore and cause higher mental load. To understand how BVI users leverage these two methods, we deployed ImageExplorer, an iOS app on the Apple App Store that provides multi-layered image information via both text-based and touch-based interfaces with customizable levels of granularity. Across 12 months, 371 users uploaded 651 images and explored 694 times. Their activities were logged to help us understand how BVI users consume image captions in the wild. This work informs a holistic understanding of BVI users' image exploration behavior and influential factors. We provide design implications for future models of image captioning and visual access tools.

Paper available at: https://guoanhong.com/papers/W4A2024-...
The ImageExplorer app is publicly available at: https://imageexplorer.org/


Смотрите видео ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the Wild онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Anhong Guo 26 Май 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 43 раз и оно понравилось 1 людям.