Document Type

Conference Paper

Publication Date

2023

DOI

10.1145/3581641.3584049

Publication Title

IUI '23: Proceedings of the 28th International Conference on Intelligent User Interfaces

Pages

32-45

Conference Name

28th International Conference on Intelligent User Interfaces, March 27-31, 2023, Sydney, Australia

Abstract

Web data items such as shopping products, classifieds, and job listings are indispensable components of most e-commerce websites. The information on the data items are typically distributed over two or more webpages, e.g., a ‘Query-Results’ page showing the summaries of the items, and ‘Details’ pages containing full information about the items. While this organization of data mitigates information overload and visual cluttering for sighted users, it however increases the interaction overhead and effort for blind users, as back-and-forth navigation between webpages using screen reader assistive technology is tedious and cumbersome. Existing usability-enhancing solutions are unable to provide adequate support in this regard as they predominantly focus on enabling efficient content access within a single webpage, and as such are not tailored for content distributed across multiple webpages. As an initial step towards addressing this issue, we developed AutoDesc, a browser extension that leverages a custom extraction model to automatically detect and pull out additional item descriptions from the ‘details’ pages, and then proactively inject the extracted information into the ‘Query-Results’ page, thereby reducing the amount of back-and-forth screen reader navigation between the two webpages. In a study with 16 blind users, we observed that within the same time duration, the participants were able to peruse significantly more data items on average with AutoDesc, compared to that with their preferred screen readers as well as with a state-of-the-art solution.

Rights

© 2023 Copyright held by the owner/authors.

This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License.

Original Publication Citation

Prakash, Y., Sunkara, M., Lee, H.-N., Jayarathna, S., & Ashok, V. (2023). AutoDesc: Facilitating convenient perusal of web data items for blind users. IUI '23: Proceedings of the 28th International Conference on Intelligent User Interfaces (pp. 32-45) https://doi.org/10.1145/3581641.3584049

ORCID

0000-0002-6970-0203 (Sunkara), 0000-0002-4879-7309 (Jayarathna), 0000-0002-4772-1265 (Ashok)

Download

Share

COinS