Document Type

Conference Paper

Publication Date

2026

DOI

10.1145/3772363.3798940

Publication Title

CHI EA '26: Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems

Pages

Article 174

Conference Name

CHI EA '26: Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems, April 13-17, 2026, Barcelona, Spain

Abstract

Modern knowledge workplaces increasingly strain human episodic memory as individuals navigate fragmented attention, overlapping meetings, and multimodal information streams. Existing workplace tools provide partial support through note-taking or analytics but rarely integrate cognitive, physiological, and attentional context into retrievable memory representations. This paper presents the Cognitive Prosthetic Multimodal System (CPMS)—an AI-enabled proof-of-concept designed to support episodic recall in knowledge work through structured episodic capture and natural language retrieval. CPMS synchronizes speech transcripts, physiological signals, and gaze behavior into temporally aligned, JSON-based episodic records processed locally for privacy. Beyond data logging, the system includes a web-based retrieval interface that allows users to query past workplace experiences using natural language, referencing semantic content, time, attentional focus, or physiological state. We present CPMS as a functional proof-of-concept demonstrating the technical feasibility of transforming heterogeneous sensor data into queryable episodic memories. The system is designed to be modular, supporting operation with partial sensor configurations, and incorporates privacy safeguards for workplace deployment. This work contributes an end-to-end, privacy-aware architecture for AI-enabled memory augmentation in workplace settings.

Rights

© 2026 Copyright held by the owner/authors.

This work is licensed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License.

Original Publication Citation

Obiuwevwi, L., Rechowicz, K. J., Ashok, V., Shetty, S., & Jayarathna, S. (2026). Cognitive prosthetic: An AI-enabled multimodal system for episodic recall in knowledge work. In N. Oliver, D. A. Shamma, H. Candello, P. Cesar, P. Lopes, V. Artizzu, F. Draxler, G. López, A. V. Reinschluessel, X. Tong, & P. O. T. Dugas (Eds.), Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (Article 174). Association for Computing Machinery.  https://doi.org/10.1145/3772363.3798940

ORCID

0009-0009-3675-8335 (Obiuwevwi), 0000-0002-7561-9858 (Rechowicz), 0000-0002-4772-1265 (Ashok), 0000-0002-8789-0610 (Shetty), 0000-0001-5992-6818 (Jayarathna)

Download

Share

COinS