CORTEXA
← Browse
arxivcs.HC2026-07-01Cited by 1

Draped Surfaces: A Contour-Adaptive Interface Overlaid on the Physical Environment for Mixed Reality Workspaces

SoonUk Kwon, Barrett Ens, Pourang Irani

Conventional Mixed Reality (MR) workspaces are frequently organized in cockpit-like layouts, where multiple floating windows surround the user. While this configuration facilitates access to digital content, it often induces occlusion, reducing understanding of the physical environment and limiting access to real-world objects. To overcome this challenge, we present the Contour-Adaptive Mixed Environment Overlays (CAMEO), a contour-adaptive MR interface that drapes virtual windows onto physical surfaces. This design integrates digital content with nearby items, thereby improving users' visual access to background objects and supporting interaction with them. We evaluate CAMEO in two controlled studies. The first demonstrates that draping reduces hand-movement detours relative to flat mid-air surfaces, enabling more direct interaction with nearby items. The second shows that controlled window deformation does not significantly impair text legibility when compared to flat surfaces. Together, these findings contribute a novel design paradigm for MR workspaces that balances immersion, readability, and environmental understanding.

View free PDFSource page

Related papers

arxivcs.HC2026-07-04

Post-Lecture Interactive Environments for Conceptual Learning: A Randomized Comparison of Mixed Reality and Tangible Instruction in Undergraduate STEM Education

Sharmin Akter, Mohammad Abu Nasir Rakib, Eshwara Prasad Sridhar, Somik Biswas, Mahmudur Rahman, Md Rassel Raihan

Developing conceptual understanding in engineering requires learners to connect spatial reasoning with abstract representations, yet lecture-based instruction often provides limited support for this process. Interactive learning environments, including mixed reality (MR) and tang…

View free PDFSource page
arxivcs.HCcs.ET2026-07-16

Assessing Learning Processes with Multimodal Data in Virtual Reality Learning Environments

Eileen McGivney, Oluwatomilade Olarinde, Erica Kleinman, Kaylah Facey, Rana Jahani, Shripad Agashe, et al.

Assessing learning in virtual reality (VR) environments typically relied on traditional pre-post content retention tests, revealing little about the process of learnng within such immersive environments. Multimodal data from player activity in VR is promising to better measure le…

View free PDFSource page
arxivcs.HC2026-07-07

Creating a Mixed-Reality Installation with Families through Theatrical Co-Design

Pavlos Panagiotidis, Roma Patel, Boriana Koleva, Steve Benford, Jocelyn Spence, Paul Tennent, et al.

Co-designing with families for environmental sustainability relies on participatory imagination, yet habitual family roles and uneven participation, especially between adults and young children, often constrain it. A second challenge is continuity: workshop relationships and embo…

View free PDFSource page
arxivcs.HC2026-07-20

ChatMuse: Supporting In-Person Small-Group Conversation Experience with a Proactive Assistive AI Agent in Mixed Reality

Shaoze Zhou, Joaquin Frangi, Diana Nelly Rivera Rodriguez, Rawan Alghofaili, Janet G. Johnson, Lingyao Li, et al.

In-person small-group conversations occur across nearly every aspect of daily life and play a crucial role in social interaction. However, achieving effective in-person group conversations can be challenging and cognitively demanding. While recent Mixed Reality (MR) headsets show…

View free PDFSource page
arxivcs.HC2026-07-11

SyncSpace: Layout-Conditioned 3D Gaussian Splatting for Space Reskinning in Mixed Reality

Qinchuan Zhang, Weibo Xu, Yunge Wen

We present SyncSpace, a system that achieves both spatial alignment and visual consistency between a generated 3DGS world and physical space. We first scan the space via depth sensing to extract 3D bounding boxes, which we render into a layout-only panorama and feed as a geometri…

View free PDFSource page
arxivcs.CVcs.HC2026-07-08

Video-Based Detection of squint and cataract for accessibility-aware adaptive web interface rendering

Amar Ranjan Dash, Manas Ranjan Patra

Squint and cataract are major ocular disorders that majorly affect visual perception and interaction capability. This paper proposes a real-time video-based automated detection system for squint and cataract detection based on computer vision and image processing methods. The pro…

View free PDFSource page