CORTEXA
← Browse
arxivcs.HC2026-07-13

HandPad: A Bimanual Hand Interface for Fluid Window Interactions in VR

Wen Ying, Adil Rahman, Erzhen Hu, Seongkook Heo

Virtual Reality (VR) offers potential for productivity work by creating expansive displays anywhere, yet current systems often rely on external input devices that limit the on-the-go use of mobile VR. We introduce HandPad, a suite of bare-hand interaction techniques that leverage the benefits of asymmetric bimanual coordination and self-haptic support. HandPad assigns the non-dominant hand (NDH) to establish spatial frames and interaction contexts, while the dominant hand (DH) performs fine-grained manipulation. Users can use NDH gestures as an input modifier to change the mode and target of DH interactions, including multi-window navigation, in-window content interaction, and window management. The palm surface of the NDH also serves as a physical touch surface, providing passive haptic feedback for effective DH touch interaction. Both hands and their interactions are spatially remapped to the window surface, enabling comfortable and direct interaction with virtual content. An exploratory study showed that HandPad enables efficient and ergonomic interaction, demonstrating its potential as a device-free approach for knowledge work in VR.

View free PDFSource page

Related papers

arxivcs.HCcs.AIcs.GR2026-07-11

Spatula: Exploring On-Demand In-Situ Interfaces and Interaction for Attribute Control

Boyu Li, Linjie Qiu, Lin-Ping Yuan, Duotun Wang, Yue Jiang, Zeyu Wang, et al.

Controlling attributes is a critical step toward achieving the final creative outcome, yet current approaches fall short in supporting users in the iterative refinement of generative content. We propose Spatula, a proof-of-concept system that generates on-demand, in-situ attribut…

View free PDFSource page
arxivcs.HC2026-07-23

From Grasping to Speaking: Generative AI-Based Environment-Grounded VR Communication Training for Autistic Individuals

Ziming Li, Roshan L. Peiris

Autistic individuals often face barriers in workplace communication, where soft skills are embedded within ongoing tasks and surrounding environment context, not in isolated verbal exchange. Recent work has introduced LLM-driven agents into VR-based communication training and pro…

View free PDFSource page
arxivcs.CVcs.HC2026-07-22

MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction

Yue Zhao, Hongxu Liu, Feiyu Wang, Xiaoyu Yang, Tong Ge, Zhen Yang, et al.

Multimodal large language models (MLLMs) are increasingly expected to automate visualization development by generating code directly from visual designs. However, existing evaluations mainly focus on single-chart generation and overlook coordinated multi-view interface constructi…

View free PDFSource page
arxivcs.SEcs.HC2026-07-11

VRExplorer: A Model-based Approach for Semi-Automated Testing of Virtual Reality Scenes

Zhengyang Zhu, Hong-Ning Dai, Hanyang Guo, Zeqin Liao, Zibin Zheng

With the proliferation of Virtual Reality (VR) markets, VR applications are rapidly expanding in scale and complexity, thereby driving an urgent need for assuring VR software quality. Different from traditional mobile applications and computer software, VR testing faces unique ch…

View free PDFSource page
arxivcs.HCcs.AIcs.LGcs.MM2026-07-24

Unboxing Diffusion Models for the Arts: Interactive Model Bending and Practice-Based Explainability

Ahmed M. Abuzuraiq, Philippe Pasquier

Explainable AI (XAI) in creative practice can be less about technocentric explanation and more about enabling artists to inspect modify and debug models as part of making Yet largescale texttoimage diffusion systems are typically presented as opaque endtoend tools limiting this k…

View free PDFSource page
arxivcs.HCcs.RO2026-07-17

CASAband: Easy-to-Wear Textile Wristband using Shape Memory Alloy Actuators for Spatial and Temporal Haptic Feedback

Baekgyeom Kim, Anoush Sepehri, Jessica Healey, Taeuk Oh, Hyungseok Seo, Je-Sung Koh, et al.

Haptic interfaces for the wrist and forearm offer an attractive alternative to hand-worn devices as they are simple to wear, leave the hands free for interaction with the real world, and interfere minimally with natural arm motions. To be useful in real-world settings, however, s…

View free PDFSource page