Skip to main content

ImPres: An Immersive 3D Presentation Framework for Mixed Reality Enhanced Learning

  • Conference paper
  • First Online:
Advances in Web-Based Learning – ICWL 2021 (ICWL 2021)

Abstract

The understanding of three-dimensional structures is an important learning goal, e.g. in anatomy courses or archeology. However, existing 2D slide-based presentation formats are not up to this visualization task as they cannot convey depth and spatial structure well enough. Moreover, a projected slide in a lecture room can be hard to see, depending on the viewer’s position and distance from the projection. Mixed reality technology offers an innovative solution for teaching 3D structures with immersive presentations. In this paper, we present the immersive 3D presentation application ImPres. It combines traditional 2D slides with 3D augmented content. With ImPres, students can use their smartphones or tablets to view 3D objects in an augmented reality mode during the presentation. By synchronizing the 3D scene to the currently shown slide by the lecturer, students receive a 3D handout that can be placed individually in each student’s environment. Lecturers are able to use the Microsoft HoloLens as a 3D editor to precisely set up the presentation. In combination with a 2D editor for the slide design, existing lecture slides can be imported, reused and augmented for mixed reality. This way, presentations can be held in any use case where 3D content is important for the curriculum. The resulting implementation of ImPres is available as an open-source project and is applicable both in co-located lectures, as well as remote webinars.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/rwth-acis/Immersive-presentation---3D-editor, https://github.com/rwth-acis/Immersive-presentation---2D-editor, https://github.com/rwth-acis/Immersive-presentation---Backend-Coordinator.

  2. 2.

    https://unity.com.

  3. 3.

    https://github.com/microsoft/MixedRealityToolkit-Unity.

  4. 4.

    Video demonstration: https://youtu.be/HDl6TsrWH5Y.

  5. 5.

    https://www.photonengine.com/Realtime.

  6. 6.

    https://azure.microsoft.com/de-de/services/spatial-anchors/.

References

  1. Aliev, Y., Kozov, V., Ivanova, G., Ivanov, A.: 3D augmented reality software solution for mechanical engineering education. In: Rachev, B., Smrikarov, A. (eds.) Proceedings of the 18th International Conference on Computer Systems and Technologies, pp. 318–325. ACM, New York (2017). https://doi.org/10.1145/3134302.3134306

  2. Alrashidi, M., Alzahrani, A., Gardner, M., Callaghan, V.: A pedagogical virtual machine for assembling mobile robot using augmented reality. In: Schmidt, A., et al. (eds.) Proceedings of the 7th Augmented Human International Conference 2016 on - AH 2016, pp. 1–2. ACM Press, New York (2016). https://doi.org/10.1145/2875194.2875229

  3. Antoun, S., Auda, J., Schneegass, S.: SlidAR. In: Abdennadher, S., Alt, F. (eds.) Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia - MUM 2018, pp. 491–498. ACM Press, New York (2018). https://doi.org/10.1145/3282894.3289744

  4. Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Int. J. Hum.-Comput. Interac. 24(6), 574–594 (2008). https://doi.org/10.1080/10447310802205776

    Article  Google Scholar 

  5. Brooke, J.: SUS: a quick and dirty usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, I.L. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor & Francis (1996). http://www.itu.dk/courses/U/E2005/litteratur/sus.pdf

  6. Dow, S., MacIntyre, B., Lee, J., Oezbek, C., Bolter, J.D., Gandy, M.: Wizard of Oz support throughout an iterative design process. IEEE Perv. Comput. 4(4), 18–26 (2005). https://doi.org/10.1109/MPRV.2005.93

    Article  Google Scholar 

  7. Hart, S.G.: Nasa-task load index (NASA-TLX); 20 years later. Proc. Hum. Fact. Ergon. Soc. Ann. Meet. 50(9), 904–908 (2006). https://doi.org/10.1177/154193120605000909

    Article  Google Scholar 

  8. Hensen, B., Koren, I., Klamma, R., Herrler, A.: An augmented reality framework for gamified learning. In: Hancke, G., Spaniol, M., Osathanunkul, K., Unankard, S., Klamma, R. (eds.) ICWL 2018. LNCS, vol. 11007, pp. 67–76. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-96565-9_7

    Chapter  Google Scholar 

  9. Karsten, S., Jörg, D., Hornecker, E.: Learner versus system control in augmented lab experiments. In: Proceedings of the Interactive Surfaces and Spaces on ZZZ - ISS 2017, pp. 354–359. ACM Press, New York (2017). https://doi.org/10.1145/3132272.3132276

  10. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. E77-D(12), 1321–1329 (1994)

    Google Scholar 

  11. Norman, D.A.: The Design of Everyday Things: Revised and Expanded Edition, expanded Basic Books, Philadelphia (2013)

    Google Scholar 

  12. Radu, I.: Augmented reality in education: a meta-review and cross-media analysis. Pers. Ubiquit. Comput. 18(6), 1533–1543 (2014). https://doi.org/10.1007/s00779-013-0747-y

    Article  Google Scholar 

  13. Saquib, N., Kazi, R.H., Wei, L.Y., Li, W.: Interactive body-driven graphics for augmented video performance. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, pp. 1–12. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3290605.3300852

  14. Sommerauer, P., Müller, O.: Augmented reality in informal learning environments: a field experiment in a mathematics exhibition. Comput. Educ. 79, 59–68 (2014). https://doi.org/10.1016/j.compedu.2014.07.013

    Article  Google Scholar 

Download references

Acknowledgment

We thank the German Federal Ministry of Education and Research for their support within the project “Personalisierte Kompetenzentwicklung durch skalierbare Mentoringprozesse” (tech4comp; id: 16DHB2110).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Benedikt Hensen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hensen, B., Liß, L., Klamma, R. (2021). ImPres: An Immersive 3D Presentation Framework for Mixed Reality Enhanced Learning. In: Zhou, W., Mu, Y. (eds) Advances in Web-Based Learning – ICWL 2021. ICWL 2021. Lecture Notes in Computer Science(), vol 13103. Springer, Cham. https://doi.org/10.1007/978-3-030-90785-3_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90785-3_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90784-6

  • Online ISBN: 978-3-030-90785-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics