ABSTRACT
Mixed reality (MR) has changed the perspective we see and interact with our world. While the current-generation of MR head-mounted devices (HMDs) are capable of generating high quality visual contents, interation in most MR applications typically relies on in-air hand gestures, gaze, or voice. These interfaces although are intuitive to learn, may easily lead to inaccurate operations due to fatigue or constrained by the environment. In this work, we present Dual-MR, a novel MR interation system that i) synchronizes the MR viewpoints of HMD and handheld smartphone, and ii) enables precise, tactile, immersive and user-friendly object-level manipulations throught the multi-touch input of smartphone. In addition, Dual-MR allows multiple users to join the same MR coordinate system to facilite the collaborate in the same physical space, which further broadens its usability. A preliminary user study shows that our system easily overwhelms the conventional interface, which combines in-air hand gesture and gaze, in the completion time for a series of 3D object manipulation tasks in MR.
- Microsoft Corporation. 2018. Mixed Reality. (2018). https://docs.microsoft.com/zh-tw/windows/mixed-reality/.Google Scholar
- Apple Inc. 2018. ARKit. (2018). https://developer.apple.com/arkit/.Google Scholar
- PTC Inc. 2018. Vuforia. (2018). https://www.vuforia.com/.Google Scholar
- Po-Huan Tseng, Shih-Hsuan Hung, Pei-Ying Chiang, Chih-Yuan Yao, and Hung-Kuo Chu. 2018. EZ-Manipulator: Designing a mobile, fast, and ambiguity-free 3D manipulation interface using smartphones. Computational Visual Media 4, 2 (June 2018), 139--147.Google ScholarCross Ref
Index Terms
- Dual-MR: interaction with mixed reality using smartphones
Recommendations
Passive haptics based MR system for geography teaching
VRCAI '16: Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1Passive haptics in an alternative way to provide the user with realistic haptic feedback with a low cost comparing to device-based active haptics. This paper presents a mixed reality system with passive haptics integration that supports bare-hand ...
MR Coral Sea Evolved Mixed-Reality Aquarium with Physical MR Displays
VRIC '15: Proceedings of the 2015 Virtual Reality International ConferenceMR Coral Sea is a mixed-reality (MR) aquarium with which a user can play with virtual fish using Coral Display, which mediates between the real and virtual spaces with multi-sensory physical feedback. We propose physical MR displays such as Coral ...
Multimodal Feedback Pen Shaped Interface and MR Application with Spatial Reality Display
SA '21: SIGGRAPH Asia 2021 Emerging TechnologiesMultimodal interface is essential to enrich the reality of drawing in the virtual 3D environment. We propose the pen shaped interface capable of providing the following multimodal feedbacks: (1) Linear motion force feedback to express contact pressure ...
Comments