skip to main content
10.1145/3648188.3675154acmconferencesArticle/Chapter ViewAbstractPublication PageshtConference Proceedingsconference-collections
research-article
Open access

Va.Si.Li-ES: VR-based Dynamic Event Processing, Environment Change and User Feedback in Va.Si.Li-Lab

Published: 10 September 2024 Publication History

Abstract

Flexibility, adaptability, modularity, and extensibility in the context of a collaborative system are critical features for multi-user hypertext systems. In addition to facilitating acceptance and increasing reusability, these features simplify development cycles and enable a larger range of application areas. However, especially in virtual 3D hypertext systems, many of the features are only partially available or not available at all. To fill this gap, we present an approach to virtual hypertext systems for the realization of dynamic event systems. Such an event system can be created and serialized simultaneously at run time regarding the modification of situational, environmental parameters. This includes informing users and allowing them to participate in the environmental dynamics of the system. We present Va.Si.Li-ES as a module of Va.Si.Li-Lab, describe several environmental scenarios that can be adapted, and provide use cases in the context of 3D hypertext systems.

References

[1]
Giuseppe Abrami, Alexander Mehler, Mevlüt Bagci, Patrick Schrottenbacher, Alexander Henlein, Christian Spiekermann, Juliane Engel, and Jakob Schreiber. 2023. Va.Si.Li-Lab as a Collaborative Multi-User Annotation Tool in Virtual Reality and Its Potential Fields of Application. In Proceedings of the 34th ACM Conference on Hypertext and Social Media (Rome, Italy) (HT ’23). Association for Computing Machinery, New York, NY, USA, Article 22, 9 pages. https://doi.org/10.1145/3603163.3609076
[2]
Giuseppe Abrami, Alexander Mehler, and Christian Spiekermann. 2019. Graph-based Format for Modeling Multimodal Annotations in Virtual Reality by Means of VAnnotatoR. In Proceedings of the 21th International Conference on Human-Computer Interaction, HCII 2019 (Orlando, Florida, USA) (HCII 2019), Constantine Stephanidis and Margherita Antona (Eds.). Springer International Publishing, Cham, 351–358.
[3]
Giuseppe Abrami, Alexander Mehler, Christian Spiekermann, Attila Kett, Simon Lööck, and Lukas Schwarz. 2020. Educational Technologies in the area of ubiquitous historical computing in virtual reality. Taylor & Francis. https://www.routledge.com/New-Perspectives-on-Virtual-and-Augmented-Reality-Finding-New-Ways-to-Teach/Daniela/p/book/9780367432119
[4]
Giuseppe Abrami, Manuel Stoeckel, and Alexander Mehler. 2020. TextAnnotator: A UIMA Based Tool for the Simultaneous and Collaborative Annotation of Texts. In Proceedings of The 12th Language Resources and Evaluation Conference. European Language Resources Association, Marseille, France, 891–900. https://www.aclweb.org/anthology/2020.lrec-1.112
[5]
Ghaliya Al Farsi, Azmi Bin Mohd. Yusof, Awanis M. Romli, Ragad M. Tawafak, Sohail Iqbal Malik, Jasiya Jabbar, and Mohd Ezanee Bin Rsuli. 2021. A Review of Virtual Reality Applications in an Educational Domain. International Journal of Interactive Mobile Technologies (iJIM) 15, 22 (2021), 99–110. https://doi.org/10.3991/ijim.v15i22.25003
[6]
Gede Thadeo Angga Kusuma, I Made Agus Wirawan, and I Ketut Resika Arthana. 2018. Virtual Reality for Learning Fish Types in Kindergarten. International Journal of Interactive Mobile Technologies (iJIM) 12, 8 (Dec. 2018), 41––51. https://doi.org/10.3991/ijim.v12i8.9246
[7]
Somnath Arjun, GS Rajshekar Reddy, Abhishek Mukhopadhyay, Sanjana Vinod, and Pradipta Biswas. 2021. Evaluating visual variables in a virtual reality environment. In 34th British HCI Conference. BCS Learning & Development, London, UK, 11–22. https://doi.org/10.14236/ewic/HCI2021.1
[8]
Jerry Banks, I I John S. Carson, Barry L Nelson, and David M Nicol (Eds.). 2013. Discrete-event system simulation: Pearson new international edition (5 ed.). Pearson Education, London, England. 568 pages.
[9]
Kristopher Blom and Steffi Beckhaus. 2008. On the Creation of Dynamic, Interactive Virtual Environments. In IEEE VR 2008 workshop "SEARIS - Software Engineering and Architectures for Interactive Systems". Shaker, Reno, Nevada, USA, 4 pages.
[10]
Philipp Braun, Michaela Grafelmann, Felix Gill, Hauke Stolz, Johannes Hinckeldeyn, and Ann-Kathrin Lange. 2022. Virtual Reality for Immersive Multi-User Firefighter Training Scenarios. Virtual Reality & Intelligent Hardware 4, 5 (2022), 406–417. https://doi.org/10.1016/j.vrih.2022.08.006
[11]
Chen-Wei Chang, Shih-Ching Yeh, Mengtong Li, and Eason Yao. 2019. The Introduction of a Novel Virtual Reality Training System for Gynecology Learning and Its User Experience Research. IEEE Access 7 (2019), 43637–43653. https://doi.org/10.1109/ACCESS.2019.2905143
[12]
Vuthea Chheang, Patrick Saalfeld, Fabian Joeres, Christian Boedecker, Tobias Huber, Florentine Huettl, Hauke Lang, Bernhard Preim, and Christian Hansen. 2021. A collaborative virtual reality environment for liver surgery planning. Computers & Graphics 99 (2021), 234–246. https://doi.org/10.1016/j.cag.2021.07.009
[13]
Giuseppe Abrami Christian Spiekermann and Alexander Mehler. 2018. VAnnotator: a Gesture-driven Annotation Framework for Linguistic and Multimodal Annotation. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) (Miyazaki, Japan, 7-12), James Pustejovsky and Ielka van der Sluis (Eds.). European Language Resources Association (ELRA), Paris, France, 5 pages.
[14]
Christopher T. Conner and Nicholas M. Baxter. 2022. Are You a Werewolf? Teaching Symbolic Interaction Theory through Game Play. Teaching Sociology 50, 1 (2022), 17–27. https://doi.org/10.1177/0092055X211053375
[15]
Berardina De Carolis, Catherine Pelachaud, Isabella Poggi, and Mark Steedman. 2004. APML, a Markup Language for Believable Behavior Generation. Springer Berlin Heidelberg, Berlin, Heidelberg, 65–85. https://doi.org/10.1007/978-3-662-08373-4_4
[16]
Andreas Dengel, Andrea Auer, Patrick Urlbauer, and Tim Läufer. 2022. Game-Based Teaching of Basic Hardware Components With an Educational Virtual Reality at Different Levels of Immersion. In Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1 (Dublin, Ireland) (ITiCSE ’22). Association for Computing Machinery, New York, NY, USA, 138–144. https://doi.org/10.1145/3502718.3524824
[17]
Maria D’Errico. 2021. Immersive Virtual Reality as an International Collaborative Space for Innovative Simulation Design. Clinical Simulation in Nursing 54 (2021), 30–34. https://doi.org/10.1016/j.ecns.2021.01.005
[18]
David Ferrucci, Adam Lally, Karin Verspoor, and Eric Nyberg. 2009. Unstructured Information Management Architecture (UIMA) Version 1.0. OASIS Standard. https://docs.oasis-open.org/uima/v1.0/uima-v1.0.html
[19]
Sebastian J Friston, Ben J Congdon, David Swapp, Lisa Izzouzi, Klara Brandstätter, Daniel Archer, Otto Olkkonen, Felix Johannes Thiel, and Anthony Steed. 2021. Ubiq: A System to Build Flexible Social Virtual Reality Experiences. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (Osaka, Japan) (VRST ’21), Yuichi Itoh, Kazuki Takashima, Parinya Punpongsanon, Misha Sra, Kazuyuki Fujita, Shigeo Yoshida, and Piumsomboon. Tham (Eds.). Association for Computing Machinery, New York, NY, USA, Article 6, 11 pages. https://doi.org/10.1145/3489849.3489871
[20]
Scott W. Greenwald, Wiley Corning, Gavin McDowell, Pattie Maes, and John Winston Belcher. 2019. ElectroVR: An Electrostatic Playground for Collaborative, Simulation-Based Exploratory Learning in Immersive Virtual Reality. In 13th International Conference on Computer Supported Collaborative Learning, CSCL 2019, Lyon, France, June 17-21, 2019, Kristine Lund, Gerald P. Niccolai, Élise Lavoué, Cindy E. Hmelo-Silver, Gahgene Gweon, and Michael Baker (Eds.). International Society of the Learning Sciences, Lyon, France, 997–1000. https://repository.isls.org/handle/1/4597
[21]
Austin Hanus, Mindy Hoover, Alex Lim, and Jack Miller. 2019. A Collaborative Virtual Reality Escape Room with Passive Haptics. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, 1413–1414. https://doi.org/10.1109/VR.2019.8798241
[22]
Elif Hilal Korkut and Elif Surer. 2023. Visualization in virtual reality: a systematic review. Virtual Reality 27 (2023), 1–34. https://doi.org/10.1007/s10055-023-00753-8
[23]
Alexander Leonhardt, Giuseppe Abrami, Daniel Baumartz, and Alexander Mehler. 2023. Unlocking the Heterogeneous Landscape of Big Data NLP with DUUI. In Findings of the Association for Computational Linguistics: EMNLP 2023, Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 385–399. https://aclanthology.org/2023.findings-emnlp.29
[24]
Chae Heon Lim and Seul Chan Lee. 2023. The Effects of Degrees of Freedom and Field of View on Motion Sickness in a Virtual Reality Context. International Journal of Human–Computer Interaction 0, 0 (2023), 1–13. https://doi.org/10.1080/10447318.2023.2241620
[25]
Weizhou Luo, Anke Lehmann, Hjalmar Widengren, and Raimund Dachselt. 2022. Where Should We Put It? Layout and Placement Strategies of Documents in Augmented Reality for Collaborative Sensemaking. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 627, 16 pages. https://doi.org/10.1145/3491102.3501946
[26]
Alexander Mehler, Giuseppe Abrami, Christian Spiekermann, and Matthias Jostock. 2018. VAnnotatoR: A Framework for Generating Multimodal Hypertexts. In Proceedings of the 29th on Hypertext and Social Media (Baltimore, MD, USA) (HT ’18). Association for Computing Machinery, New York, NY, USA, 150–154. https://doi.org/10.1145/3209542.3209572
[27]
Alexander Mehler, Mevlüt Bagci, Alexander Henlein, Giuseppe Abrami, Christian Spiekermann, Patrick Schrottenbacher, Maxim Konca, Andy Lücking, Juliane Engel, Marc Quintino, Jakob Schreiber, Kevin Saukel, and Olga Zlatkin-Troitschanskaia. 2023. A Multimodal Data Model for Simulation-Based Learning with Va.Si.Li-Lab. In Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management, Vincent G. Duffy (Ed.). Springer Nature Switzerland, Cham, 539–565. https://doi.org/10.1007/978-3-031-35741-1_39
[28]
Naoaki Okazaki, Sohei Aya, Santi Saeyor, and Mitsuru Ishizuka. 2002. A Multimodal Presentation Markup Language MPML-VR for a 3D virtual space. In Workshop on Virtual Conversational Characters: Applications, Methods, and Research Challenges. Melbourne, Australia, 4 pages.
[29]
Nikolaos Pellas, Andreas Dengel, and Athanasios Christopoulos. 2020. A Scoping Review of Immersive Virtual Reality in STEM Education. IEEE Transactions on Learning Technologies 13, 4 (2020), 748–761. https://doi.org/10.1109/TLT.2020.3019405
[30]
Veljko Potkonjak, Michael Gardner, Victor Callaghan, Pasi Mattila, Christian Guetl, Vladimir M. Petrović, and Kosta Jovanović. 2016. Virtual Laboratories for Education in Science, Technology, and Engineering. Comput. Educ. 95, C (April 2016), 309–327. https://doi.org/10.1016/j.compedu.2016.02.002
[31]
P. Rander, P.J. Narayanan, and T. Kanade. 1997. Virtualized reality: constructing time-varying virtual worlds from real world events. In Proceedings. Visualization ’97 (Cat. No. 97CB36155). IEEE, Phoenix, AZ, USA, 277–283. https://doi.org/10.1109/VISUAL.1997.663893
[32]
Marius Rubo, Nadine Messerli, and Simone Munsch. 2021. The human source memory system struggles to distinguish virtual reality and reality. Computers in Human Behavior Reports 4 (2021), 6 pages. https://doi.org/10.1016/j.chbr.2021.100111
[33]
Esther Sackett and Lisa M. Amoroso. 2024. A Little “Edutainment” Goes a Long Way: Leveraging Among Us®, a Popular Multiplayer Game, to Teach Persuasion Virtually. Management Teaching Review 9, 1 (2024), 7–21. https://doi.org/10.1177/23792981221104197
[34]
Shiri Savir, Adnan A. Khan, Rayaan A. Yunus, Taha A. Rehman, Shirin Saeed, Mahnoor Sohail, Aidan Sharkey, John Mitchell, and Robina Matyal. 2023. Virtual Reality: The Future of Invasive Procedure Training?Journal of Cardiothoracic and Vascular Anesthesia 37, 10 (2023), 2090–2097. https://doi.org/10.1053/j.jvca.2023.06.032
[35]
Manolis Savva, Angel X. Chang, and Pat Hanrahan. 2015. Semantically-enriched 3D models for common-sense knowledge. In 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, Boston, MA, USA, 24–31. https://doi.org/10.1109/CVPRW.2015.7301289
[36]
Sharad Sharma, Phillip Devreaux, David Scribner, Jock Grynovicki, and Peter Grazaitis. 2017. Megacity: A Collaborative Virtual Reality Environment for Emergency Response, Training, and Decision Making. Electronic Imaging 29, 1 (2017), 70–70. https://doi.org/10.2352/ISSN.2470-1173.2017.1.VDA-390
[37]
Jan Springer, Carsten Neumann, Dirk Reiners, and Carolina Cruz-Neira. 2011. An Integrated Pipeline to Create and Experience Compelling Scenarios in Virtual Reality. Proceedings of SPIE - The International Society for Optical Engineering 7864 (01 2011). https://doi.org/10.1117/12.879278
[38]
Wernhuar Tarng, Chia-Jung Chen, Chi-Young Lee, Chih-Ming Lin, and Yu-Jun Lin. 2019. Application of Virtual Reality for Learning the Material Properties of Shape Memory Alloys. Applied Sciences 9, 3 (2019), 21 pages. https://doi.org/10.3390/app9030580
[39]
Dimitrios Ververidis, Spiros Nikolopoulos, and Ioannis Kompatsiaris. 2022. A Review of Collaborative Virtual Reality Systems for the Architecture, Engineering, and Construction Industry. Architecture 2, 3 (2022), 476–496. https://doi.org/10.3390/architecture2030027
[40]
Krzysztof Walczak, Rafal Wojciechowski, and Wojciech Cellary. 2006. Dynamic interactive VR network services for education. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Limassol, Cyprus) (VRST ’06). Association for Computing Machinery, New York, NY, USA, 277––286. https://doi.org/10.1145/1180495.1180552
[41]
Wan Mohd Rizhan Wan Idris, Rizhan Idris, Elissa Nadia Madi, Md Yazid, and Mohd Saman. 2011. Developing Dynamic Virtual Environments Using Hierarchical, Tree-Structured Approach. The International Journal of Multimedia & Its Applications 3 (04 2011), 17 pages. https://doi.org/10.5121/ijma.2011.3205
[42]
Tzong-Hann Wu, Feng Wu, Ci-Jyun Liang, Yi-Fen Li, Ching-Mei Tseng, and Shih-Chung Kang. 2019. A virtual reality tool for training in global engineering collaboration. Universal Access in the Information Society 18 (2019), 1243–255. https://doi.org/10.1007/s10209-017-0594-0

Cited By

View all
  • (2024)Towards New Data Spaces for the Study of Multiple Documents with Va.Si.Li-Lab: A Conceptual AnalysisStudents’, Graduates’ and Young Professionals’ Critical Use of Online Information10.1007/978-3-031-69510-0_12(259-303)Online publication date: 5-Aug-2024

Index Terms

  1. Va.Si.Li-ES: VR-based Dynamic Event Processing, Environment Change and User Feedback in Va.Si.Li-Lab

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      HT '24: Proceedings of the 35th ACM Conference on Hypertext and Social Media
      September 2024
      415 pages
      ISBN:9798400705953
      DOI:10.1145/3648188
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 10 September 2024

      Check for updates

      Author Tags

      1. Collaborative Simulation
      2. Environmental Event System
      3. Hypertext
      4. Ubiq
      5. Va.Si.Li-Lab
      6. Virtual Reality

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      HT '24
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 378 of 1,158 submissions, 33%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)128
      • Downloads (Last 6 weeks)33
      Reflects downloads up to 20 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Towards New Data Spaces for the Study of Multiple Documents with Va.Si.Li-Lab: A Conceptual AnalysisStudents’, Graduates’ and Young Professionals’ Critical Use of Online Information10.1007/978-3-031-69510-0_12(259-303)Online publication date: 5-Aug-2024

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media