CORTEXA
← Browse
arxivcs.HC2026-07-23Cited by 0

Reimagining the Augmented Reality Accessibility Ecosystem for Deaf Students: Service Provider Perspectives in Experiential Learning

Roshan Mathew, Roshan Peiris

In experiential learning environments, Deaf and hard of hearing (DHH) students often experience ``split attention,'' dividing their focus among tasks, instructors, and access providers. Augmented reality (AR) has been proposed as a means to centralize communication access within the student's field of view; however, little is known about how such systems affect the instructors, interpreters, and captioners who support access in these settings. We present a formative, expert-based evaluation of ARRAE, an AR-mediated communication access ecosystem, examining the experiences of an instructor, an American Sign Language (ASL) interpreter, and a real-time captioner in a simulated laboratory environment. Comparing in-person, traditional remote, and AR-mediated access, our findings suggest that AR reconfigures accessibility labor and interactional practices by redistributing communication, attention, and awareness across participants. While AR-mediated access supported integrated, in-situ communication and enhanced contextual awareness, it also altered interactional feedback mechanisms, such as gaze coordination and pacing, that support shared understanding during instruction. These observations highlight trade-offs between access, control, and coordination, and suggest that AR-mediated systems may be most effective when considered as part of a broader, hybrid ecosystem rather than as standalone replacements for existing modalities. This work contributes initial insights into how AR reshapes communication access in experiential learning and informs the design of systems that support coordinated, multi-user interaction in hands-on educational contexts.

View free PDFSource page

Related papers

arxivcs.HCcs.ET2026-07-16

Assessing Learning Processes with Multimodal Data in Virtual Reality Learning Environments

Eileen McGivney, Oluwatomilade Olarinde, Erica Kleinman, Kaylah Facey, Rana Jahani, Shripad Agashe, et al.

Assessing learning in virtual reality (VR) environments typically relied on traditional pre-post content retention tests, revealing little about the process of learnng within such immersive environments. Multimodal data from player activity in VR is promising to better measure le…

View free PDFSource page
arxivcs.HC2026-07-07

Head, Gaze, or Finger? Comparing Object Selection Techniques in Augmented Reality for People with Low Vision

Ruijia Chen, Tianyi Zhang, Sanbrita Mondal, Yukang Yan, Yuhang Zhao

Augmented reality (AR) can enhance visual perception for people with low vision (PLV) by overlaying multimodal information. Selection-based augmentation further allows users to flexibly choose and augment relevant information while reducing distraction and visual clutter. However…

View free PDFSource page
arxivcs.CVcs.ETcs.HC2026-07-15

Marker-free deformable registration and fusion for augmented reality-guided positive margin localization during tumor resection surgery

Yue Yang, Annie Benson, Matthieu Chabanas, Jason Slagle, Thomas Myles, Matthew B. Weinger, et al.

Positive margins in head and neck oncologic surgery require mapping specimen-side pathology findings to the patient resection bed. This is challenging because pathologists identify the positive margin on slices of the resected, deformed specimen, while surgeons must relocate the…

View free PDFSource page
arxivcs.HC2026-07-11

Learning behavior accounts for background-related advantage in AI-assisted education

Jingwei Yi, Yueqi Xie, Jiyan He, Rui Ye, Junming Huang, Bin Zhu, et al.

Generative AI has been found, and will likely be found increasingly, useful in education. However, existing AI-for-education studies provide inconsistent evidence on its average effects. More broadly, research on prior educational technologies shows that average effects often mas…

View free PDFSource page
arxivcs.ROcs.HCcs.LG2026-07-22

Towards Miniature Humanoid Tele-Loco-Manipulation Using Virtual Reality and Reinforcement Learning

Nicolas Kosanovic, Jordan Dowdy, Jean Chagas Vaz

Full-sized humanoid robot capabilities have grown exponentially in recent years, aiming towards general-purpose deployment in human environments. A popular control method used by manufacturers utilizes Virtual Reality for upper-body teleoperation and Reinforcement Learning for lo…

View free PDFSource page
arxivcs.HC2026-07-24

VisionPulse: A Virtual Reality System Enabling Accessible Discovery and Navigation for Blind and Low Vision Users

Samuel Martin, Pooyan Fazli, Hasti Seifi

Free exploration is an important aspect of many engaging virtual reality (VR) experiences, yet remains largely inaccessible to blind and low vision (BLV) users due to its reliance on visual feedback. Existing approaches support BLV navigation through prebuilt menus of environment…

View free PDFSource page