skip to main content
10.1145/3670653.3677477acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmundcConference Proceedingsconference-collections
short-paper

Ground Control: Leveraging the User's Spatial Position as an Input Modality in an Embodied Immersive Analysis Use Case

Published: 01 September 2024 Publication History

Abstract

Extended Reality (XR) has already enabled sophisticated implementations of immersive visualizations, providing a more intuitive and engaging way of analyzing data. Yet, the user interaction with such immersive visualizations remains challenging, often relying on hand tracking or additional devices. We introduce a novel XR prototype that leverages the concept of embodied exploration, allowing users to interact with an exemplary visualization directly through their spatial position within the room relative to the displayed data. This approach eliminates the need for handheld controllers, offering a more intuitive engagement with the visualization. Our preliminary evaluation with twelve participants reveals a general preference for using XR for immersive visualizations compared to PC and paper-based versions. We suggest further research into non-standard interaction and exploration modalities for data analysis applications using XR, potentially offering new possibilities for engaging interactions with data.

References

[1]
Hind Benbya, Ning Nan, Hüseyin Tanriverdi, and Youngjin Yoo. 2020. Complexity and Information Systems Research in the Emerging Digital World.
[2]
Todd V Billow and Joseph A Cottam. 2017. Exploring the Use of Heuristics for Evaluation of an Immersive Analytic System. (2017).
[3]
Rubén Casado and Muhammad Younas. 2015. Emerging Trends and Technologies in Big Data Processing. Concurrency and Computation: Practice and Experience 27, 8 (2015), 2078–2091. https://doi.org/10.1002/cpe.3398
[4]
Maxime Cordeil, Andrew Cunningham, Tim Dwyer, Bruce H. Thomas, and Kim Marriott. 2017. ImAxes: Immersive Axes as Embodied Affordances for Interactive Multivariate Data Visualisation. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, Québec City QC Canada, 71–83. https://doi.org/10.1145/3126594.3126613
[5]
J. Durbin, J.E. Swan, B. Colbert, J. Crowe, R. King, T. King, C. Scannell, Z. Wartell, and T. Welsh. 1998. Battlefield Visualization on the Responsive Workbench. In Proceedings Visualization ’98 (Cat. No.98CB36276). 463–466. https://doi.org/10.1109/VISUAL.1998.745344
[6]
Brian Fisher. 2005. Illuminating the Path: An R&D Agenda for Visual Analytics. 69–104.
[7]
Adrien Fonnet and Yannick Prié. 2021. Survey of Immersive Analytics. IEEE Transactions on Visualization and Computer Graphics 27, 3 (March 2021), 2101–2122. https://doi.org/10.1109/TVCG.2019.2929033
[8]
Juliano Franz, Joseph Malloch, Derek Reilly, and Luciana Nedel. 2017. More Than Blips on the Radar: Exploring Immersive Visualization for Maritime Decision Making. (2017).
[9]
Markus Funk, Thomas Kosch, and Albrecht Schmidt. 2016. Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Heidelberg, Germany) (UbiComp ’16). Association for Computing Machinery, New York, NY, USA, 934–939. https://doi.org/10.1145/2971648.2971706
[10]
Hong-zhi Hu, Xiao-bo Feng, Zeng-wu Shao, Mao Xie, Song Xu, Xing-huo Wu, and Zhe-wei Ye. 2019. Application and Prospect of Mixed Reality Technology in Medical Field. Current Medical Science 39, 1 (Feb. 2019), 1–6. https://doi.org/10.1007/s11596-019-1992-8
[11]
Christopher Katins, Sebastian S. Feger, and Thomas Kosch. 2023. Exploring Mixed Reality in General Aviation to Support Pilot Workload. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems(CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3585742
[12]
Christopher Katins, Paweł W. Woźniak, Aodi Chen, Ihsan Tumay, Luu Viet Trinh Le, John Uschold, and Thomas Kosch. 2024. Assessing User Apprehensions About Mixed Reality Artifacts and Applications: The Mixed Reality Concerns (MRC) Questionnaire. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’24). Association for Computing Machinery, New York, NY, USA, Article 604, 13 pages. https://doi.org/10.1145/3613904.3642631
[13]
Thomas Kosch, Andrii Matviienko, Florian Müller, Jessica Bersch, Christopher Katins, Dominik Schön, and Max Mühlhäuser. 2022. NotiBike: Assessing Target Selection Techniques for Cyclist Notifications in Augmented Reality. Proceedings of the ACM on Human-Computer Interaction 6, MHCI (2022), 1–24.
[14]
Zhen Li, Michelle Annett, Ken Hinckley, Karan Singh, and Daniel Wigdor. 2019. HoloDoc: Enabling Mixed Reality Workspaces That Harness Physical and Digital Content. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300917
[15]
Tica Lin, Rishi Singh, Yalong Yang, Carolina Nobre, Johanna Beyer, Maurice A. Smith, and Hanspeter Pfister. 2021. Towards an Understanding of Situated AR Visualization for Basketball Free-Throw Training. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3411764.3445649
[16]
Robb Lindgren, Michael Tscholl, Shuai Wang, and Emily Johnson. 2016. Enhancing Learning and Engagement through Embodied Interaction within a Mixed Reality Simulation. Computers & Education 95 (April 2016), 174–187. https://doi.org/10.1016/j.compedu.2016.01.001
[17]
Katsutoshi Masai, Takuma Kajiyama, Tadashi Muramatsu, Maki Sugimoto, and Toshitaka Kimura. 2022. Virtual Reality Sonification Training System Can Improve a Novice’s Forehand Return of Serve in Tennis. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 845–849. https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00182
[18]
Andrew Moran, Vijay Gadepally, Matthew Hubbell, and Jeremy Kepner. 2015. Improving Big Data Visual Analytics with Interactive Virtual Reality. In 2015 IEEE High Performance Extreme Computing Conference (HPEC). 1–6. https://doi.org/10.1109/HPEC.2015.7322473
[19]
Matthew Ready, Tim Dwyer, and Jason H Haga. 2018. Immersive Visualisation of Big Data for River Disaster Management. (2018).
[20]
Andreas Riegler, Andreas Riener, and Clemens Holzmann. 2020. A Research Agenda for Mixed Reality in Automated Vehicles. In Proceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia(MUM ’20). Association for Computing Machinery, New York, NY, USA, 119–131. https://doi.org/10.1145/3428361.3428390
[21]
David Saffo, Sara Di Bartolomeo, Tarik Crnovrsanin, Laura South, Justin Raynor, Caglar Yildirim, and Cody Dunne. 2023. Unraveling the Design Space of Immersive Analytics: A Systematic Review. IEEE Transactions on Visualization and Computer Graphics PP (Oct. 2023), 1–12. https://doi.org/10.1109/TVCG.2023.3327368
[22]
Martin Schrepp, Andreas Hinderks, and Jörg Thomaschewski. 2017. Construction of a Benchmark for the User Experience Questionnaire (UEQ). International Journal of Interactive Multimedia and Artificial Intelligence 4, 4 (2017). https://doi.org/10.9781/ijimai.2017.445
[23]
B. Shneiderman. 1996. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Proceedings 1996 IEEE Symposium on Visual Languages. 336–343. https://doi.org/10.1109/VL.1996.545307
[24]
M. Tory and T. Moller. 2004. Human Factors in Visualization Research. IEEE Transactions on Visualization and Computer Graphics 10, 1 (Jan. 2004), 72–84. https://doi.org/10.1109/TVCG.2004.1260759
[25]
Zhu Wang, Liraz Arie, Anat V. Lubetzky, and Ken Perlin. 2021. VRGaitAnalytics: Visualizing Dual Task Cost for VR Gait Assessment. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology(VRST ’21). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3489849.3489874
[26]
Yalong Yang, Tim Dwyer, Kim Marriott, Bernhard Jenny, and Sarah Goodwin. 2021. Tilt Map: Interactive Transitions Between Choropleth Map, Prism Map and Bar Chart in Immersive Environments. IEEE Transactions on Visualization and Computer Graphics 27, 12 (Dec. 2021), 4507–4519. https://doi.org/10.1109/TVCG.2020.3004137
[27]
Yidan Zhang, Barrett Ens, Kadek Satriadi, Arnaud Prouzeau, and Sarah Goodwin. 2022. TimeTables: Embodied Exploration of Immersive Spatio-Temporal Data. 605 pages. https://doi.org/10.1109/VR51125.2022.00080
[28]
Mengya Zheng and Abraham G. Campbell. 2019. Location-Based Augmented Reality In-situ Visualization Applied for Agricultural Fieldwork Navigation. In 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 93–97. https://doi.org/10.1109/ISMAR-Adjunct.2019.00039

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MuC '24: Proceedings of Mensch und Computer 2024
September 2024
719 pages
ISBN:9798400709982
DOI:10.1145/3670653
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Embodied
  2. Extended Reality
  3. Immersive Analytics
  4. Interaction

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Funding Sources

  • CRC 1404 FONDA

Conference

MuC '24
MuC '24: Mensch und Computer 2024
September 1 - 4, 2024
Karlsruhe, Germany

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 26
    Total Downloads
  • Downloads (Last 12 months)26
  • Downloads (Last 6 weeks)2
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media