ImageExplorer CHI 2022 (Video)
ImageExplorer: Multi-Layered Touch Exploration to Encourage Skepticism Towards Imperfect AI-Generated Image Captions
CHI 2022, Video
Authors:
Jaewook Lee, Jaylin Herskovitz, Yi-Hao Peng, Anhong Guo
Abstract:
Blind users rely on alternative text (alt-text) to understand an image; however, alt-text is often missing. AI-generated captions are a more scalable alternative, but they often miss crucial details or are completely incorrect, which users may still falsely trust. In this work, we sought to determine how additional information could help users better judge the correctness of AI-generated captions. We developed ImageExplorer, a touch-based multi-layered image exploration system that allows users to explore the spatial layout and information hierarchies of images, and compared it with popular text-based (Facebook) and touch-based (Seeing AI) image exploration systems in a study with 12 blind participants. We found that exploration was generally successful in encouraging skepticism towards imperfect captions. Moreover, many participants preferred ImageExplorer for its multi-layered and spatial information presentation, and Facebook for its summary and ease of use. Finally, we identify design improvements for effective and explainable image exploration systems for blind users.
The 30s video preview is available at: • ImageExplorer CHI 2022 (30s Preview)
The talk is available at: • ImageExplorer CHI 2022 (Talk)
Paper available at: https://guoanhong.com/papers/CHI22-Im...
Watch video ImageExplorer CHI 2022 (Video) online without registration, duration hours minute second in high quality. This video was added by user Anhong Guo 07 January 2022, don't forget to share it with your friends and acquaintances, it has been viewed on our site 153 once and liked it 1 people.