Skip to main content
SpringerLink
Log in

Authoring tools for virtual reality experiences: a systematic review

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Virtual reality (VR) is used in different application fields like health, tourism, or training. Most VR applications for these fields have been built from the ground up without any authoring tool to help the process. This systematic review surveys the existing literature on authoring tools for immersive content and critically analyzes its features and how they are evaluated. It proposes a research agenda with key contribution opportunities for the field. An analysis of the 29 studies that met the eligibility criteria revealed that four records did not present any evaluation regarding the authoring tools’ evaluation, and only five records used specialized users to evaluate their authoring tools; all the others used non-specialized users. The most evaluated metrics were usability, effectiveness, efficiency, and satisfaction. The data collected to evaluate the metrics consisted mainly of Likert scales and reported mean opinion score (MOS). However, few records used well-established questionnaires to evaluate those metrics like System Usability Scale, Post-Study System Usability Questionnaire, After-Scenario Questionnaire and Igroup Presence Questionnaire. Additionally, five of the analyzed records included stimuli other than audiovisual. More research is recommended about the usage of ontologies in authoring tools to comprehend the full potential of its usage since none of them had ontologies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Arndt T, Katz E (2010) Visual software tools for multimedia authoring. J Vis Lang Comput 21(3):184–191. https://doi.org/10.1016/j.jvlc.2009.12.005

    Article  Google Scholar 

  2. Bassbouss L, Steglich S, Fritzsch I (2019) Interactive 360o video and storytelling tool. In: 2019 IEEE 23rd International Symposium on Consumer Technologies (ISCT). IEEE, pp 113–117

  3. Bessa M, Melo M, de Sousa A A, Vasconcelos-Raposo J (2018) The effects of body position on reflexive motor acts and the sense of presence in virtual environments. Comput Graph 71:35–41. https://doi.org/10.1016/j.cag.2017.11.003

    Article  Google Scholar 

  4. Blonna R, Tan M S, Tan V, Mora A P, Atienza R (2018) VREX: A framework for immersive virtual reality experiences. In: 2018 IEEE Region Ten Symposium (Tensymp). IEEE, pp 118–123

  5. Brooke J (1996) Sus-a quick and dirty usability scale. digital equipment co ltd. Reading

  6. Buttussi F, Chittaro L (2018) Effects of different types of virtual reality display on presence and learning in a safety training scenario. IEEE Trans Vis Comput Graph 24(2):1063–1076. https://doi.org/10.1109/TVCG.2017.2653117

    Article  Google Scholar 

  7. Cassola F, Pinto M, Mendes D, Morgado L, Coelho A, Paredes H (2021) A novel tool for immersive authoring of experiential learning in virtual reality. In: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE

  8. Chu J, Bryan C, Shih M, Ferrer L, Ma K-L (2017) Navigable videos for presenting scientific data on affordable head-mounted displays. In: Proceedings of the 8th ACM on multimedia systems conference. ACM, pp 250–260

  9. Coelho H, Melo M, Barbosa L, Martins J, Sérgio M, Bessa M (2018) Immersive edition of multisensory 360 videos. Adv Intell Syst Comput 746:309–318. https://doi.org/10.1007/978-3-319-77712-2_30

    Google Scholar 

  10. Coelho H, Melo M, Barbosa L, Martins J, Teixeira M S, Bessa M Authoring tools for creating 360 multisensory videos - evaluation of different interfaces. Adv Intell Syst Comput 746:309318. https://doi.org/10.1111/exsy.12418

  11. Coelho H, Melo M, Martins J, Bessa M (2019) Collaborative immersive authoring tool for real-time creation of multisensory VR experiences. Multimed Tools Appl 78 (14):19473–19493. https://doi.org/10.1007/s11042-019-7309-x

    Article  Google Scholar 

  12. Connolly T M, Boyle E A, MacArthur E, Hainey T, Boyle J M (2012) A systematic literature review of empirical evidence on computer games and serious games. Comput Educ 59(2):661–686. https://doi.org/10.1016/j.compedu.2012.03.004

    Article  Google Scholar 

  13. Danieau F, Guillotel P, Dumas O, Lopez T, Leroy B, Mollet N (2018) Hfx studio: Haptic editor for full-body immersive experiences. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology. ACM

  14. de Barros P G, Lindeman R W (2013) Performance effects of multi-sensory displays in virtual teleoperation environments. In: Proceedings of the 1st symposium on Spatial user interaction - SUI’13. ACM Press

  15. Feng M, Dey A, Lindeman R W (2016) The effect of multi-sensory cues on performance and experience during walking in immersive virtual environments. In: 2016 IEEE Virtual Reality (VR). IEEE

  16. Feng Z, González V A, Amor R, Lovreglio R, Cabrera-Guerrero G (2018) Immersive virtual reality serious games for evacuation training and research: a systematic literature review. Comput Educ 127:252–266. https://doi.org/10.1016/j.compedu.2018.09.002

    Article  Google Scholar 

  17. Fidas C, Sintoris C, Yiannoutsou N, Avouris N (2015) A survey on tools for end user authoring of mobile applications for cultural heritage. In: 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA). IEEE

  18. Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, Slater M (2017) Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med 47(14):2393–2400. https://doi.org/10.1017/s003329171700040x

    Article  Google Scholar 

  19. Fröhlich J, Wachsmuth I (2013) The visual, the auditory and the haptic – a user study on combining modalities in virtual worlds. In: Virtual augmented and mixed reality. Designing and developing augmented and virtual environments. Springer, Berlin, pp 159–168

  20. Gai W, Yang C, Bian Y, Shen C, Meng X, Wang L, Liu J, Dong M, Niu C, Lin C (2017) Supporting easy physical-to-virtual creation of mobile VR maze games. In: Proceedings of the 2017 CHI Conference on Human factors in computing systems. ACM, pp 5016–5028

  21. Gonçalves G, Melo M, Vasconcelos-Raposo J, Bessa M (2020) A novel method to enhance the touristic 360o promotional video experience. Multimed Tools Appl. https://doi.org/10.1007/s11042-020-09026-x

  22. Horst R, Diez S, Dörner R (2019) Highlighting techniques for 360o video virtual reality and their immersive authoring. Lecture notes in Computer Science (including subseries Lecture notes in Artificial Intelligence and Lecture notes in Bioinformatics) 11844 LNCS:515–526. https://doi.org/10.1007/978-3-030-33720-9_40

    Google Scholar 

  23. Kaskalis T, Tzidamis T D, Margaritis K (2007) Multimedia authoring tools: The quest for an educational package. J Educ Technol Soc 10:135–162

    Google Scholar 

  24. Khundam C (2020) Storytelling platform for interactive digital content in virtual museum. ECTI Trans Comput Inf Technol (ECTI-CIT) 15(1):34–49. https://doi.org/10.37936/ecti-cit.2021151.239948

    Article  Google Scholar 

  25. Kim J (2019) Maze terrain authoring system in immersive virtual reality for new visual realism. Symmetry 11(4):490. https://doi.org/10.3390/sym11040490

    Article  Google Scholar 

  26. Kodama R, Koge M, Taguchi S, Kajimoto H (2017) COMS-VR: Mobile virtual reality entertainment system using electric car and head-mounted display. In: 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE

  27. Lan G, Sun J, Li C, Ou Z, Luo Z, Liang J, Hao Q (2016) Development of UAV based virtual reality systems. In: 2016 IEEE International conference on multisensor fusion and integration for intelligent systems (MFI). IEEE

  28. Lee J, Jeong K, Kim J (2017) MAVE: Maze-based immersive virtual environment for new presence and experience. Comput Anim. Virtual Worlds 28 (3-4):e1756. https://doi.org/10.1002/cav.1756

    Article  Google Scholar 

  29. Leon J D O D, Tavas R P, Aranzanso R A, Atienza R O (2016) Genesys: A virtual reality scene builder. In: 2016 IEEE Region 10 Conference (TENCON). IEEE, pp 3708–3711

  30. Lewis J R (1995) IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. Int J Hum-Comput Interact 7(1):57–78. https://doi.org/10.1080/10447319509526110

    Article  Google Scholar 

  31. Meira J, Marques J, Jacob J, Nobrega R, Rodrigues R, Coelho A, de Sousa A A (2016) Video annotation for immersive journalism using masking techniques. In: 2016 23o Encontro Português de Computao Grfica e Interaçāo (EPCGI). IEEE

  32. Melo M, Goncalves G, Monteiro P, Coelho H, Vasconcelos-Raposo J, Bessa M (2020) Do multisensory stimuli benefit the virtual reality experience? a systematic review. IEEE Trans Vis Comput Graph:1–1. https://doi.org/10.1109/TVCG.2020.3010088

  33. Mendes P R C, Guedes A L V, de S. Moraes D, Azevedo R G A, Colcher S (2020) An authoring model for interactive 360 videos. In: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). IEEE

  34. Mo Y, Zhao D, Du J, Liu W, Dhara A (2018) Data-driven approach to scenario determination for VR-based construction safety training. In: Construction Research Congress 2018. American Society of Civil Engineers, pp 116–125

  35. Moher D, Liberati A, Tetzlaff J, Altman D G, Group TP (2009) Preferred reporting items for systematic reviews and meta-analyses: the prisma statement. PLOS Med 6(7):1–6. https://doi.org/10.1371/journal.pmed.1000097

    Article  Google Scholar 

  36. Narciso D, Melo M, Raposo J V, Cunha J , Bessa M (2019) Virtual reality in training: an experimental study with firefighters. Multimed Tools Appl 79(9-10):6227–6245. https://doi.org/10.1007/s11042-019-08323-4

    Article  Google Scholar 

  37. Nguyen C, DiVerdi S, Hertzmann A, Liu F (2017) Vremiere: In-headset virtual reality video editing. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, pp 5428–5438

  38. Office I (2012) International standard classification of occupations 2008 (isco-08) : Structure, group definitions and correspondence tables. International Labour Office, Geneva

    Google Scholar 

  39. Puget J, Pardoen M, Bouillot N, Durand E, Seta M, Bastien P (2019) Rapid prototyping of immersive video for popularization of historical knowledge. In: Proceedings of the thirteenth international conference on tangible, embedded, and embodied interaction. ACM, pp 197–203

  40. Seo J, Kim D, Kim G (2001) Vr object reuse through component combination

  41. Shah S H H, Han K, Lee J W (2020) Real-time application for generating multiple experiences from 360o panoramic video by tracking arbitrary objects and viewer’s orientations. Appl Sci 10(7):2248. https://doi.org/10.3390/app10072248

    Article  Google Scholar 

  42. Shah S H H, Lee J W (2019) Authoring tool for generating multiple experiences of 360o virtual reality. Lect Notes Electr Eng 536 LNEE:73–78. https://doi.org/10.1007/978-981-13-9341-9_13

    Google Scholar 

  43. Slater M, Sanchez-Vives M V (2016) Enhancing our lives with immersive virtual reality. Front Robot AI 3. https://doi.org/10.3389/frobt.2016.00074

  44. Slater M, Wilbur S (1997) A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators Virtual Environ 6(6):603–616. https://doi.org/10.1162/pres.1997.6.6.603

    Article  Google Scholar 

  45. Torres A, Carmichael C, Wang W, Paraskevakos M, Uribe-Quevedo A, Giles P, Yawney J L (2020) A 360 video editor framework for interactive training. In: 2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH). IEEE

  46. van der Meij E, Anema J R, Otten R H J, Huirne J A F, Schaafsma F G (2016) The effect of perioperative e-health interventions on the postoperative course: a systematic review of randomised and non-randomised controlled trials. PLOS One 11(7):e0158612. https://doi.org/10.1371/journal.pone.0158612

    Article  Google Scholar 

  47. Vasconcelos-Raposo J, Bessa M, Melo M, Barbosa L, Rodrigues R, Teixeira C M, Cabral L, Sousa A A (2016) Adaptation and validation of the igroup presence questionnaire (IPQ) in a Portuguese sample. Presence: Teleoperators Virtual Environ 25(3):191–203. https://doi.org/10.1162/PRES_a_00261

    Article  Google Scholar 

  48. Wallach H S, Safir M P, Samana R (2009) Personality variables and presence. Virtual Real 14(1):3–13. https://doi.org/10.1007/s10055-009-0124-3

    Article  Google Scholar 

  49. Wang J, Lindeman R (2014) Coordinated 3d interaction in tablet- and HMD-based hybrid virtual environments. In: Proceedings of the 2nd ACM symposium on Spatial user interaction - SUI ’14. ACM Press, pp 70–79

  50. Wilcocks K, Kapralos B, Quevedo A U, Alam F, Dubrowski A (2020) The anesthesia crisis scenario builder for authoring anesthesia crisis-based simulations. IEEE Trans Games 12(4):361–366. https://doi.org/10.1109/tg.2020.3003315

    Article  Google Scholar 

  51. Witmer B G, Singer M J (1998) Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators Virtual Environ 7 (3):225–240. https://doi.org/10.1162/105474698565686

    Article  Google Scholar 

  52. Zarraonandia T, Díaz P, Montero A, Aedo I (2016) Exploring the benefits of immersive end user development for virtual reality. Lecture notes in Computer Science (including subseries Lecture notes in Artificial Intelligence and Lecture notes in Bioinformatics) 10069 LNCS:450–462. https://doi.org/10.1007/978-3-319-48746-5_46

    Google Scholar 

  53. Zhang L, Oney S (2020) FlowMatic: An immersive authoring tool for creating interactive scenes in virtual reality. In: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM

  54. Zhao Z, Ma X (2020) Shadowplay2.5d: A 360-degree video authoring tool for immersive appreciation of classical chinese poetry. J Comput Cultural Heritage 13(1):1–20. https://doi.org/10.1145/3352590

    Article  MathSciNet  Google Scholar 

  55. Zidianakis E, Partarakis N, Ntoa S, Dimopoulos A, Kopidaki S, Ntagianta A, Ntafotis E, Xhako A, Pervolarakis Z, Kontaki E, Zidianaki I, Michelakis A, Foukarakis M, Stephanidis C (2021) The invisible museum: A user-centric platform for creating virtual 3d exhibitions with VR support. Electronics 10(3):363. https://doi.org/10.3390/electronics10030363

    Article  Google Scholar 

  56. Zikas P, Papagiannakis G, Lydatakis N, Kateros S, Ntoa S, Adami I, Stephanidis C (2020) Immersive visual scripting based on VR software design patterns for experiential training. Vis Comput 36(10-12):1965–1977. https://doi.org/10.1007/s00371-020-01919-0

    Article  Google Scholar 

Download references

Acknowledgements

This work was done partially funded by the project SFRH/BD/147913/2019 entitled Authoring Framework for Interactive and Immersive Virtual Reality Training financed by the FCT - Fundação para a Ciência e a Tecnologia. This work was also partially funded by the European Union’s Horizon 2020 - The EU Framework Programme for Research and Innovation 2014-2020, under grant agreement No. 833573.

Author information

Authors and Affiliations

  1. Institute for Systems and Computer Engineering, Technology and Science, Porto, Portugal

    Hugo Coelho, Pedro Monteiro, Guilherme Gonçalves, Miguel Melo & Maximino Bessa

  2. University of Trás-os-Montes e Alto Douro, Vila Real, Portugal

    Maximino Bessa

Authors
  1. Hugo Coelho
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pedro Monteiro
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guilherme Gonçalves
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Miguel Melo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maximino Bessa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hugo Coelho.

Ethics declarations

All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Coelho, H., Monteiro, P., Gonçalves, G. et al. Authoring tools for virtual reality experiences: a systematic review. Multimed Tools Appl 81, 28037–28060 (2022). https://doi.org/10.1007/s11042-022-12829-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12829-9

Keywords

Search

Navigation