Skip to main content
Springer Nature Link
Log in

Designing a Learning Analytics Application to Improve Learner Success in Interactions Based on Multimodal Dialogue Systems

  • Conference paper
  • First Online:
Immersive Learning Research Network (iLRN 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 621))

Included in the following conference series:

  • 1170 Accesses

Abstract

Learning processes supported by multimodal interaction systems demand effective tools to measure learner performance and provide meaningful feedback to stakeholders. This paper reviews key features and discusses the implementation of a learning analytics tool that is part of an e-learning multimodal dialogue system, which, in turn, is part of an immersive environment to support different learning scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Rating scale with the possible following values: 1 extremely poor, 2 poor, 3 below average, 4 average, 5 above average, 6 good and 7 extremely good.

  2. 2.

    Rating score with the possible following values: 0 - worst, 1 very poor, 2 poor, 3 significantly below average, 4 below average, 5 average, 6 above average, 7 significantly above average, 8 good, 9 very good and 10 optimal.

  3. 3.

    Rating scale with the possible following values: 1 very low, 2 low, 3 average, 4 high and 5 very high.

References

  1. Li, L., Li, Q., Chou, W., Liu, F.: R-flow: an extensible XML based multimodal dialog system architecture. In: Proceedings of the 2007 IEEE 9th International Workshop on Multimedia Signal Processing, MMSP 2007, pp. 86–89 (2007)

    Google Scholar 

  2. Alexandersson, J., Aretoulaki, M., Campbell, N., Gardner, M., Girenko, A., Klakow, D., Koryzis, D., Petukhova, V., Specht, M., Spiliotopoulos, D., Stricker, A., Taatgen, N.: Metalogue: a multiperspective multimodal dialogue system with metacognitive abilities for highly adaptive and flexible dialogue management. In: 2014 10th International Conference on Intelligent Environments, pp. 365–368 (2014)

    Google Scholar 

  3. Tan, J.T.C., Duan, F., Inamura, T.: Multimodal human-robot interaction with Chatterbot system: extending AIML towards supporting embodied interactions. In: 2012 IEEE International Conference on Robotics and Biomimetics, ROBIO 2012 - Conference Digest, pp. 1727–1732 (2012)

    Google Scholar 

  4. Hagiwara, Y.: Cloud based VR system with immersive interfaces to collect multimodal data in human-robot interaction. In: 2015 IEEE 4th Global Conference on Consumer Electronics (GCCE), pp. 256–259 (2015)

    Google Scholar 

  5. Gagne, R.: The Conditions of Learning and Theory of Instruction. Holt, Rinehart and Winston, New York (1985)

    Google Scholar 

  6. Merrill, M.D.: Instructional transaction theory: an instructional design model based on knowledge objects. Educ. Technol. 36(3), 3037 (1996)

    Google Scholar 

  7. Endsley, M.R.: Measurement of situation awareness in dynamic systems. Hum. Factors 37(1), 6584 (1995). doi:10.1518/001872095779049499

    Google Scholar 

  8. Endsley, M.R.: Theoretical underpinnings of situation awareness: a critical review. In: Endsley, M.R., Garland, D.J. (eds.) Situation Awareness Analysis and Measurement, p. 332. CRC Press, Boca Raton (2000)

    Google Scholar 

  9. Fiaidhi, J.: The next step for learning analytics. IT Prof. 16(5), 48 (2014)

    Article  Google Scholar 

  10. Larusson, J., White, B.: Learning Analytics. Springer, New York (2013)

    Google Scholar 

  11. Lee, J.: The Glass Classroom: Big Data Transforms Higher Education, Glassclassroom.blogspot.co.uk (2012). http://glassclassroom.blogspot.co.uk/2012/12/the-glass-classroom-big-data.html. Accessed 25 Feb 2016

  12. Kb.wisc.edu: Pattern - Learning Analytics (2016). https://kb.wisc.edu/pattern-learning-analytics. Accessed 25 Feb 2016

  13. Society for Learning Analytics Research (SoLAR) (2016). https://solaresearch.org/. Accessed 25 Feb 2016

  14. Tltl.stanford.edu: Multimodal Learning Analytics — Transformative Learning Technologies Lab (2016). https://tltl.stanford.edu/project/multimodal-learning-analytics. Accessed 25 Feb 2016

  15. Worsley, M., Mall, G.: Multimodal Learning Analytics as a Tool for Bridging Learning Theory and Complex Learning Behaviors, p. 14 (2014)

    Google Scholar 

  16. Van Helvert, J., Van Rosmalen, P., Brner, D., Petukhova, V., Alexandersson, J.: Observing coaching and reflecting: a multi-modal natural language-based dialogue system in a learning context. In: Proceedings of the Intelligent Environments Conference (IE 2015), pp. 13–14. IOS Press, Prague, Czech Republic, July 2015

    Google Scholar 

  17. Hoogveld, A.W.M., Paas, F., Jochems, W.M.G.: Application of an instructional systems design approach by teachers in higher education: individual versus team design. Teach. Teach. Educ. 19, 581–590 (2003)

    Article  Google Scholar 

  18. Nadolski, R.J., Kirschner, P.A., van Merrinboer, J.J.G.: Process support in learning tasks for acquiring complex cognitive skills in the domain of law. Learn. Instruct. 16, 266–278 (2006)

    Article  Google Scholar 

  19. Clark, R.E., Feldon, D.F., van Merrienboer, J.J.G., Yates, K.A., Early, S.: Handbook of Research on Educational Communications and Technology (2008)

    Google Scholar 

  20. Worsley, M.: Multimodal learning analytics - enabling the future of learning through multimodal data analysis and interfaces. In: International Conference on Motivational Interviewing, p. 1215 (2012)

    Google Scholar 

  21. Anasol, C., Rios, P.: Exploring Mixed Reality in Distributed Collaborative Learning Environments, Ph.D. thesis, University of Essex, p. 71 (2016)

    Google Scholar 

  22. De La Fuente, L., Burgos, D.: A4Learning: an iterative methodological approach to support better learning and teaching. IEEE Lat. Am. Trans. 13(2), 483–489 (2015)

    Article  Google Scholar 

  23. Scott, P., Tomadaki, E., Quick, K.: The shape of online meetings. Int. J. Technol. Knowl. Soc. 3(4), 116 (2007)

    Google Scholar 

  24. Herzog, G., Reithinger, N.: The SmartKom architecture: a framework for multimodal dialogue systems. In: Wahlster, W. (ed.) SmartKom: Foundations of Dialogue Systems, pp. 55–70. Springer, Heidelberg (2006). doi:10.1007/3-540-36678-4

    Chapter  Google Scholar 

  25. W3.org: Date and Time Formats (2016). https://www.w3.org/TR/NOTE-datetime. Accessed 29 Feb 2016

  26. Law, N.: Pedagogy and ICT Use in Schools Around the World, pp. 135–148. Springer, New York (2008)

    Book  Google Scholar 

  27. Bl.ocks.org: D3 Radar Chart (2016). http://bl.ocks.org/chrisrzhou/2421ac6541b68c1680f8. Accessed 29 Feb 2016

Download references

Acknowledgments

The material included in this paper represents the out come of all members of the Metalogue research project, which is partly funded by the European Union Framework 7 ICT programme, under grant agreement 611073. http://www.metalogue.eu.

Author information

Authors and Affiliations

  1. School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, CO4 3SQ, UK

    Emmanuel Ferreyra Olivares, Joy van Helvert & Michael Gardner

  2. German Research Centre for Artificial Intelligence GmbH (DFKI), Saarbrücken, Germany

    Pierre Albert

Authors
  1. Emmanuel Ferreyra Olivares
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pierre Albert
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Joy van Helvert
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael Gardner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Emmanuel Ferreyra Olivares .

Editor information

Editors and Affiliations

  1. University of St Andrews, St Andrews, United Kingdom

    Colin Allison

  2. INESC TEC and Universidade Aberta, Coimbra, Portugal

    Leonel Morgado

  3. Inst. for Info. System & Comp. System, Graz University of Technology, Graz, Austria

    Johanna Pirker

  4. University of Arkansas, Fayetteville, Arkansas, USA

    Dennis Beck

  5. Salish Kootenai College, Pablo, Montana, USA

    Jonathon Richter

  6. Inst. for Info. System & Comp. System, Graz University of Technology, Graz, Austria

    Christian Gütl

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Olivares, E.F., Albert, P., van Helvert, J., Gardner, M. (2016). Designing a Learning Analytics Application to Improve Learner Success in Interactions Based on Multimodal Dialogue Systems. In: Allison, C., Morgado, L., Pirker, J., Beck, D., Richter, J., Gütl, C. (eds) Immersive Learning Research Network. iLRN 2016. Communications in Computer and Information Science, vol 621. Springer, Cham. https://doi.org/10.1007/978-3-319-41769-1_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41769-1_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41768-4

  • Online ISBN: 978-3-319-41769-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation