BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface Actuation
UIST 2023, Video
Authors:
Chen Liang, Yasha Iravantchi, Thomas Krolikowski, Ruijie Geng, Alanson Sample, Anhong Guo
Abstract:
Touchscreen devices, designed with an assumed range of user abilities and interaction patterns, often present challenges for individuals with diverse abilities to operate independently. Prior efforts to improve accessibility through tools or algorithms necessitated alterations to touchscreen hardware or software, making them inapplicable for the large number of existing legacy devices. In this paper, we introduce BrushLens, a hardware interaction proxy that performs physical interactions on behalf of users while allowing them to continue utilizing accessible interfaces, such as screenreaders and assistive touch on smartphones, for interface exploration and command input. BrushLens maintains an interface model for accurate target localization and utilizes exchangeable actuators for physical actuation across a variety of device types, effectively reducing user workload and minimizing the risk of mistouch. Our evaluations reveal that BrushLens lowers the mistouch rate and empowers visually and motor impaired users to interact with otherwise inaccessible physical touchscreens more effectively.
The 30s video preview is available at: • BrushLens UIST 2023 (30s Preview)
Paper available at: https://guoanhong.com/papers/UIST23-B...
Watch video BrushLens UIST 2023 (Video) online without registration, duration hours minute second in high quality. This video was added by user Anhong Guo 04 September 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 154 once and liked it 2 people.