When Realities Interweave: Exploring the Design Space of Immersive Tangible XR
Authors: 
Jakob Carl Uhl, 
Helmut Schrom-Feiertag, 
Georg Regal, 
Linda Hirsch, Yannick Weiss, Manfred TscheligiAuthors Info & Claims
Jakob Carl Uhl, Helmut Schrom-Feiertag, Georg Regal, Linda Hirsch, Yannick Weiss, Manfred TscheligiAuthors Info & ClaimsArticle No.: 67, Pages 1 - 4
Abstract
Tangible devices and interaction in Extended Reality (XR) increase immersion and enable users to perform tasks more intuitively, accurately and joyfully across the reality-virtuality continuum. Upon reviewing the literature, we noticed no clear trend for a publication venue, as well as no standard in evaluating the effects of tangible XR. To position the topic of tangible XR in the TEI community, we propose a hands-on studio, where participants will bring in their own ideas for tangible XR from their application fields, and develop prototypes with the cutting-edge technology and a selection of virtual assets provided. Additionally, we will collectively reflect upon evaluation methods on tangible XR, and aim to find a consensus of a core evaluation suite. With this, we aim to foster a practical understanding and spark new developments in tangible XR and its use cases within the TEI community.
References
[1]
Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1968–1979. https://doi.org/10.1145/2858036.2858226
[2]
Steve Olusegun Bada and Steve Olusegun. 2015. Constructivism learning theory: A paradigm for teaching and learning. Journal of Research & Method in Education 5, 6 (2015), 66–70.
[3]
Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2014. Displaying Shapes with Various Types of Surfaces Using Visuo-Haptic Interaction. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology(Edinburgh, Scotland) (VRST ’14). Association for Computing Machinery, New York, NY, USA, 191–196. https://doi.org/10.1145/2671015.2671028
[4]
Joanna Bergström, Aske Mottelson, and Jarrod Knibbe. 2019. Resized Grasping in VR: Estimating Thresholds for Object Discrimination. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 1175–1183. https://doi.org/10.1145/3332165.3347939
[5]
Ayush Bhardwaj, Junghoon Chae, Richard Noeske, and Jin Ryong Kim. 2021. TangibleData: Interactive data visualization with mid-air haptics. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST(VRST ’21). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3489849.3489890
[6]
Lai Lila Bozgeyikli and Evren Bozgeyikli. 2022. Tangiball: Foot-Enabled Embodied Tangible Interaction with a Ball in Virtual Reality. In Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2022. 812–820. https://doi.org/10.1109/VR51125.2022.00103
[7]
Dragoş Datcu, Stephan Lukosch, and Frances Brazier. 2015. On the Usability and Effectiveness of Different Interaction Types in Augmented Reality. International Journal of Human–Computer Interaction 31, 3(2015), 193–209. https://doi.org/10.1080/10447318.2014.994193
[8]
Alexandre G. De Siqueira, Pedro G. Feijoo-Garcia, and Sean P. Stanley. 2021. BlockXR: A Novel Tangible Block-Based Programming Platform. In Proceedings of IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC, Vol. 2010-Octob. 1–4. https://doi.org/10.1109/VL/HCC51201.2021.9576344
[9]
David Englmeier, Joseph O’Hagan, Mengyi Zhang, Florian Alt, Andreas Butz, Tobias Höllerer, and Julie Williamson. 2020. TangibleSphere - Interaction Techniques for Physical and Virtual Spherical Displays. In ACM International Conference Proceeding Series. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3419249.3420101
[10]
Barrett Ens, Sarah Goodwin, Arnaud Prouzeau, Fraser Anderson, Florence Y. Wang, Samuel Gratzl, Zac Lucarelli, Brendan Moyle, Jim Smiley, and Tim Dwyer. 2021. Uplift: A Tangible and Immersive Tabletop System for Casual Collaborative Visual Analytics. IEEE Transactions on Visualization and Computer Graphics 27, 2 (feb 2021), 1193–1203. https://doi.org/10.1109/TVCG.2020.3030334
[11]
Renaud Gervais, Joan Sol Roo, and Martin Hachet. 2016. Tangible viewports: Getting out of flatland in desktop environments. In TEI 2016 - Proceedings of the 10th Anniversary Conference on Tangible Embedded and Embodied Interaction(TEI ’16). Association for Computing Machinery, New York, NY, USA, 176–184. https://doi.org/10.1145/2839462.2839468
[12]
Ziyi Gong, Geping Wang, and Qiong Wu. 2019. Grey Island: Immersive tangible interaction through augmented reality. In Proceedings - 2019 IEEE 4th International Conference on Data Science in Cyberspace, DSC 2019, Vol. 2019-Janua. IEEE, 656–661. https://doi.org/10.1109/DSC.2019.00107
[13]
Aakar Gupta, Bo Rui Lin, Siyi Ji, Arjav Patel, and Daniel Vogel. 2020. Replicate and Reuse: Tangible Interaction Design for Digitally-Augmented Physical Media Objects. In Conference on Human Factors in Computing Systems - Proceedings. 1–12. https://doi.org/10.1145/3313831.3376139
[14]
Vedad Hulusic, Linda Gusia, Nita Luci, and Michael Smith. 2021. Tangible Interfaces for VR Cultural Heritage Application-School House Virtual Museum. (2021).
[15]
Gun A. Lee and Gerard J. Kim. 2009. Immersive authoring of Tangible Augmented Reality content: A user study. Journal of Visual Languages and Computing 20, 2 (2009), 61–79. https://doi.org/10.1016/j.jvlc.2008.07.001
[16]
Jae Yeol Lee, Gue Won Rhee, and Hyungjun Park. 2009. AR/RP-based tangible interactions for collaborative design evaluation of digital products. International Journal of Advanced Manufacturing Technology 45, 7-8 (dec 2009), 649–665. https://doi.org/10.1007/s00170-009-2012-0
[17]
Tianren Luo, Mingmin Zhang, Zhigeng Pan, Zheng Li, Ning Cai, Jinda Miao, Youbin Chen, and Mingxi Xu. 2020. Dream-Experiment: A MR User Interface with Natural Multi-channel Interaction for Virtual Experiments. IEEE Transactions on Visualization and Computer Graphics 26, 12(2020), 3524–3534. https://doi.org/10.1109/TVCG.2020.3023602
[18]
Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: A class of displays on the reality-virtuality continuum. In Telemanipulator and telepresence technologies, Vol. 2351. Spie, 282–292.
[19]
Zhigeng Pan, Tianren Luo, Mingmin Zhang, Ning Cai, Yongheng Li, Jinda Miao, Zheng Li, Zhipeng Pan, Yuze Shen, and Jijian Lu. 2022. MagicChem: a MR system based on needs theory for chemical experiments. Virtual Reality 26, 1 (mar 2022), 279–294. https://doi.org/10.1007/s10055-021-00560-z
[20]
Hyungjun Park, Ho Kyun Jung, and Sang Jin Park. 2014. Tangible AR interaction based on fingertip touch using small-sized nonsquare markers. Journal of Computational Design and Engineering 1, 4(2014), 289–297. https://doi.org/10.7315/JCDE.2014.028
[21]
Hyungjun Park and Hee Cheol Moon. 2013. Design evaluation of information appliances using augmented reality-based tangible interaction. Computers in Industry 64, 7 (2013), 854–868. https://doi.org/10.1016/j.compind.2013.05.006
[22]
Hyungjun Park, Hee Cheol Moon, and Jae Yeol Lee. 2009. Tangible augmented prototyping of digital handheld products. Computers in Industry 60, 2 (2009), 114–125. https://doi.org/10.1016/j.compind.2008.09.001
[23]
Sharif Razzaque, Zachariah Kohn, and Mary C. Whitton. 2001. Redirected Walking. In Eurographics 2001 - Short Presentations. Eurographics Association. https://doi.org/10.2312/egs.20011036
[24]
Majed Samad, Elia Gatti, Anne Hermes, Hrvoje Benko, and Cesare Parise. 2019. Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300550
[25]
Zackary P.T. Sin, Peter H.F. Ng, and Hong Va Leong. 2021. Stuffed Toy as an Appealing Tangible Interface for Children. In Proceedings - 23rd IEEE International Symposium on Multimedia, ISM 2021. IEEE, 75–78. https://doi.org/10.1109/ISM52913.2021.00020
[26]
Peng Wang, Xiaoliang Bai, Mark Billinghurst, Shusheng Zhang, Dechuan Han, Mengmeng Sun, Zhuo Wang, Hao Lv, and Shu Han. 2020. Haptic Feedback Helps Me? A VR-SAR Remote Collaborative System with Tangible Interaction. International Journal of Human–Computer Interaction 36, 13(2020), 1242–1257. https://doi.org/10.1080/10447318.2020.1732140
[27]
Xiangyu Wang and Phillip S. Dunston. 2013. Tangible mixed reality for remote design review: a study understanding user perception and acceptance. Visualization in Engineering 1, 1 (dec 2013). https://doi.org/10.1186/2213-7459-1-8
[28]
Yun Wen. 2018. Chinese character composition game with the augment paper. Educational Technology and Society 21, 3 (2018), 132–145.
[29]
Katrin Wolf and Timm Bäder. 2015. Illusion of Surface Changes Induced by Tactile and Visual Touch Feedback. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 1355–1360. https://doi.org/10.1145/2702613.2732703
Index Terms
- When Realities Interweave: Exploring the Design Space of Immersive Tangible XR
Recommendations
Tangible VR: Traversing Space in XR to Grow a Virtual Butterfly
SUI '20: Proceedings of the 2020 ACM Symposium on Spatial User InteractionImmersive reality technologies have been widely utilized in the area of cultural heritage, also known as Virtual Heritage. We present a tangible Virtual Reality (VR) interaction demo that allows users to freely walk in the physical space while engaging ...
An Authoring Tool for XR Learning Environments
Extended RealityAbstractThe creation of extended reality applications, which combine elements of virtual reality, augmented reality and mixed reality, is complex and demanding, especially in education where its use has grown exponentially in recent years. This paper ...
Visualizing the keyboard in virtual reality for enhancing immersive experience
SIGGRAPH '17: ACM SIGGRAPH 2017 PostersRecently, virtual reality (VR) becomes more and more popular and provides users an immersive experience with a head-mounted display (HMD). However, in some applications, users have to interact with physical objects while immersed in VR. With a non-see-...
Comments
Information & Contributors
Information
Published In
February 2023
709 pages
ISBN:9781450399777
DOI:10.1145/3569009
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 February 2023
Check for updates
Author Tags
Qualifiers
- Abstract
- Research
- Refereed limited
Funding Sources
- FFG - Die Österreichische Forschungsförderungsgesellschaft
- DFG - Deutsche Forschungsgemeinschaft
- Horizon 2020 Framework Programme
Conference
TEI '23
Sponsor:
TEI '23: Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction
February 26 - March 1, 2023
Warsaw, Poland
Acceptance Rates
Overall Acceptance Rate 393 of 1,367 submissions, 29%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 252Total Downloads
- Downloads (Last 12 months)82
- Downloads (Last 6 weeks)12
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format