abstract

Dual-MR: interaction with mixed reality using smartphones

Authors:

Chi-Jung Lee,

Hung-Kuo ChuAuthors Info & Claims

VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

Article No.: 79, Pages 1 - 2

https://doi.org/10.1145/3281505.3281618

Published: 28 November 2018 Publication History

Get Access

Abstract

Mixed reality (MR) has changed the perspective we see and interact with our world. While the current-generation of MR head-mounted devices (HMDs) are capable of generating high quality visual contents, interation in most MR applications typically relies on in-air hand gestures, gaze, or voice. These interfaces although are intuitive to learn, may easily lead to inaccurate operations due to fatigue or constrained by the environment. In this work, we present Dual-MR, a novel MR interation system that i) synchronizes the MR viewpoints of HMD and handheld smartphone, and ii) enables precise, tactile, immersive and user-friendly object-level manipulations throught the multi-touch input of smartphone. In addition, Dual-MR allows multiple users to join the same MR coordinate system to facilite the collaborate in the same physical space, which further broadens its usability. A preliminary user study shows that our system easily overwhelms the conventional interface, which combines in-air hand gesture and gaze, in the completion time for a series of 3D object manipulation tasks in MR.

References

[1]

Microsoft Corporation. 2018. Mixed Reality. (2018). https://docs.microsoft.com/zh-tw/windows/mixed-reality/.

Google Scholar

[2]

Apple Inc. 2018. ARKit. (2018). https://developer.apple.com/arkit/.

Google Scholar

[3]

PTC Inc. 2018. Vuforia. (2018). https://www.vuforia.com/.

Google Scholar

[4]

Po-Huan Tseng, Shih-Hsuan Hung, Pei-Ying Chiang, Chih-Yuan Yao, and Hung-Kuo Chu. 2018. EZ-Manipulator: Designing a mobile, fast, and ambiguity-free 3D manipulation interface using smartphones. Computational Visual Media 4, 2 (June 2018), 139--147.

Crossref

Google Scholar

Cited By

View all

Katins CWoźniak PChen ATumay ILe LUschold JKosch T(2024)Assessing User Apprehensions About Mixed Reality Artifacts and Applications: The Mixed Reality Concerns (MRC) QuestionnaireProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642631(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642631
Abdul Halim NIsmail A(2024)3D Selection Techniques for Distant Object Interaction in Augmented RealityEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_488(51-58)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_488
Hu BZhang YHao STao Y(2023)MOFA: Exploring Asymmetric Mixed Reality Design Strategy for Co-located Multiplayer Between Handheld and Head-mounted Augmented RealityExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583935(1-4)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583935
Show More Cited By

Index Terms

Dual-MR: interaction with mixed reality using smartphones
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Mixed / augmented reality

Recommendations

Passive haptics based MR system for geography teaching
VRCAI '16: Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1

Passive haptics in an alternative way to provide the user with realistic haptic feedback with a low cost comparing to device-based active haptics. This paper presents a mixed reality system with passive haptics integration that supports bare-hand ...
MR Coral Sea Evolved Mixed-Reality Aquarium with Physical MR Displays
VRIC '15: Proceedings of the 2015 Virtual Reality International Conference

MR Coral Sea is a mixed-reality (MR) aquarium with which a user can play with virtual fish using Coral Display, which mediates between the real and virtual spaces with multi-sensory physical feedback. We propose physical MR displays such as Coral ...
Multimodal Feedback Pen Shaped Interface and MR Application with Spatial Reality Display
SA '21: SIGGRAPH Asia 2021 Emerging Technologies

Multimodal interface is essential to enrich the reality of drawing in the virtual 3D environment. We propose the pen shaped interface capable of providing the following multimodal feedbacks: (1) Linear motion force feedback to express contact pressure ...

Comments

Information & Contributors

Information

Published In

VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

November 2018

570 pages

ISBN:9781450360869

DOI:10.1145/3281505

Editor:
Stephen N. Spencer
University of Washington
,
General Chair:
Shigeo Morishima
Waseda University
,
Program Chairs:
Yuichi Itoh
Osaka University
,
Takaaki Shiratori
Facebook Reality Labs
,
Yonghao Yue
The University of Tokyo
,
Rob Lindeman
University of Canterbury

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2018

Check for updates

Author Tags

Qualifiers

Abstract

Conference

VRST '18

Sponsor:

VRST '18: 24th ACM Symposium on Virtual Reality Software and Technology

November 28 - December 1, 2018

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
352
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)4

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Katins CWoźniak PChen ATumay ILe LUschold JKosch T(2024)Assessing User Apprehensions About Mixed Reality Artifacts and Applications: The Mixed Reality Concerns (MRC) QuestionnaireProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642631(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642631
Abdul Halim NIsmail A(2024)3D Selection Techniques for Distant Object Interaction in Augmented RealityEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_488(51-58)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_488
Hu BZhang YHao STao Y(2023)MOFA: Exploring Asymmetric Mixed Reality Design Strategy for Co-located Multiplayer Between Handheld and Head-mounted Augmented RealityExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583935(1-4)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583935
Hubenschmid SZagermann JLeicht DReiterer HFeuchtner T(2023)ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial MemoryProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581438(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581438
Jannat MHasan K(2023)Exploring the Effects of Virtually-Augmented Display Sizes on Users’ Spatial Memory in Smartwatches2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00070(553-562)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00070
Hubenschmid SWieland JFink DBatch AZagermann JElmqvist NReiterer H(2022)ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User StudiesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517550(1-20)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517550
Krug KBuschel WKlamka KDachselt R(2022)CleAR Sight: Exploring the Potential of Interacting with Transparent Tablets in Augmented Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00034(196-205)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00034
Zhang XHe WBillinghurst MLiu DYang LFeng SLiu Y(2022)Usability of Cross-Device Interaction Interfaces for Augmented Reality in Physical TasksInternational Journal of Human–Computer Interaction10.1080/10447318.2022.216053740:9(2361-2379)Online publication date: 28-Dec-2022
https://doi.org/10.1080/10447318.2022.2160537
Zhang LHe WBai HZou QWang SBillinghurst M(2022)A hybrid 2D–3D tangible interface combining a smartphone and controller for virtual realityVirtual Reality10.1007/s10055-022-00735-227:2(1273-1291)Online publication date: 18-Dec-2022
https://doi.org/10.1007/s10055-022-00735-2
Abdul Halim NIsmail A(2022)3D Selection Techniques for Distant Object Interaction in Augmented RealityEncyclopedia of Computer Graphics and Games10.1007/978-3-319-08234-9_488-1(1-8)Online publication date: 10-May-2022
https://doi.org/10.1007/978-3-319-08234-9_488-1
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Passive haptics based MR system for geography teaching

MR Coral Sea Evolved Mixed-Reality Aquarium with Physical MR Displays

Multimodal Feedback Pen Shaped Interface and MR Application with Spatial Reality Display

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations