Document Type

Article

Publication Date

2025

DOI

10.1109/THMS.2025.3573173

Publication Title

IEEE Transactions on Human-Machine Systems

Volume

Article in Press

Pages

1-9

Abstract

Artificial Intelligence (AI) is crucial to numerous functions required for driving automation systems, including the computer vision techniques used to detect the roadway environment and make real-time decisions. However, the images used as inputs to the AI system may be maliciously perturbed, or manipulated, causing the AI system to make an incorrect classification. In this study, we examined humans’ perception of the AI’s computer vision capability of classifying various road sign images, including the original images, images with two different types of malicious attacks, and images that are scrambled randomly at the pixel level. Our results showed that participants rated the AI agent to be less capable than themselves of classifying the road signs. However, they overestimated the AI’s computer vision capability for correctly classifying images with malicious attacks that should cause the AI system to misclassify the image. These findings suggest that people lack an accurate understanding of the vulnerabilities of AI computer vision technologies and tend to overtrust AI in driving automation systems.

Rights

© 2025 The Authors.

This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License.

Original Publication Citation

Garcia, K. R., Chen, J., Xiao, Y., Mishler, S., Wang, C., & Hu, B. (2025). Human perception of AI capabilities at classifying perturbed roadway signs. IEEE Transactions on Human-Machine Systems. Advance online publication. https://doi.org/10.1109/THMS.2025.3573173

ORCID

0000-0001-9104-1710 (Mishler)

Download

Share

COinS