Skip to main content
SpringerLink
Log in

Applying Natural Language Processing to Teamwork – A New Dashboard for CTMTC Methodology

  • Conference paper
  • First Online:
Learning and Collaboration Technologies. Novel Technological Environments (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13329))

Included in the following conference series:

  • 944 Accesses

Abstract

In our current society the acquisition of competences such as teamwork is essential. However, the evaluation of how this competence is developed is not easy and requires methodologies and tools to support the assessment process. In this sense several Learning Analytics tools have been developed. They explore students’ interactions in different types of tools such as forums or instant messaging apps. However those tools are especially focused on the quantitative evaluation of the interaction and are not very usable. This work presents a new dashboard that analyzes students’ Telegram interactions while they work as a team to address a project. The innovation of this tool lies in the functionalities included to explore not only numbers about messages, replies, type of messages, characters, etc., but the content of the texts. To do so natural language processing and sentiment analysis libraries were used. The tool has been tested successfully with 4 subject editions in which it is possible to appreciate an evolution in students’ interactions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Colomo-Palacios, R., Casado-Lumbreras, C., Soto-Acosta, P., García-Peñalvo, F.J., Tovar-Caro, E.: Competence gaps in software personnel: a multi-organizational study. Comput. Hum. Behav. 29, 456–461 (2013)

    Article  Google Scholar 

  2. Leidner, D.E., Jarvenpaa, S.L.: The use of information technology to enhance management school education: a theoretical view. MIS Q. 19, 265–291 (1995)

    Google Scholar 

  3. Vogel, D.R., Davison, R.M., Shroff, R.H.: Sociocultural learning: a perspective on GSS-enabled global education. Commun. Assoc. Inf. Syst. 7, 9 (2001)

    Google Scholar 

  4. Alonso de Castro, M.G., García-Peñalvo, F.J.: Metodologías educativas de éxito: proyectos Erasmus+ relacionados con e-learning o TIC. Campus Virtuales 11, 95–114 (2022)

    Google Scholar 

  5. Conde, M.A., Rodriguez-Sedano, F.J., Hernandez-Garcia, A., GutiérrezFernández, A., Guerrero-Higueras, A.M.: Your teammate just sent you a new message! The effects of using telegram on individual acquisition of teamwork competence. Int. J. Interact. Multimedia Artif. Intell. 6, 225–233 (2021)

    Google Scholar 

  6. Fidalgo, A., Leris, D., Sein-Echaluce, M.L., García-Peñalvo, F.J.: Indicadores para el seguimiento de evaluación de la competencia de trabajo en equipo a través del método CTMT. Congreso Internacional sobre Aprendizaje Innovación y Competitividad - CINAIC 2013, Madrid, Spain (2013)

    Google Scholar 

  7. Fidalgo-Blanco, Á., Lerís, D., Sein-Echaluce, M.L., García-Peñalvo, F.J.: Monitoring indicators for CTMTC: comprehensive training model of the teamwork competence in engineering domain. Int. J. Eng. Educ. (IJEE) 31, 829–838 (2015)

    Google Scholar 

  8. NCB: Bases para la competencia en dirección de proyectos. http://www.lpzconsulting.com/images/CP-_Trabajo_en_Equipo.pdf. Accessed 28 Feb 2014

  9. Conde, M.A., Colomo-Palacios, R., García-Peñalvo, F.J., Larrucea, X.: Teamwork assessment in the educational web of data: a learning analytics approach towards ISO 10018. Telematics Inform. 35, 551–563 (2018)

    Article  Google Scholar 

  10. Conde, M.Á., Rodríguez-Sedano, F.J., Sánchez-González, L., Fernández-Llamas, C., Rodríguez-Lera, F.J., Matellán-Olivera, V.: Evaluation of teamwork competence acquisition by using CTMTC methodology and learning analytics techniques. In: Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality, pp. 787–794. ACM, Salamanca (2016)

    Google Scholar 

  11. Séin-Echaluce, M.L., Fidalgo Blanco, Á., García-Peñalvo, F.J., Conde, M.Á.: A knowledge management system to classify social educational resources within a subject using teamwork techniques. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2015. LNCS, vol. 9192, pp. 510–519. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20609-7_48

    Chapter  Google Scholar 

  12. Fidalgo-Blanco, Á., Sein-Echaluce, M.L., García-Peñalvo, F.J., Conde, M.Á.: Using learning analytics to improve teamwork assessment. Comput. Hum. Behav. 47, 149–156 (2015)

    Article  Google Scholar 

  13. Sein-Echaluce, M.L., Fidalgo-Blanco, Á., García-Peñalvo, F.J.: Students’ knowledge sharing to improve learning in engineering academic courses. Int. J. Eng. Educ. (IJEE) 32, 1024–1035 (2016)

    Google Scholar 

  14. Conde, M.Á., Hernández-García, Á., García-Peñalvo, F.J., Fidalgo-Blanco, Á., Sein-Echaluce, M.: Evaluation of the CTMTC methodology for assessment of teamwork competence development and acquisition in higher education. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2016. LNCS, vol. 9753, pp. 201–212. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-39483-1_19

    Chapter  Google Scholar 

  15. Conde, M.Á., Rodríguez-Sedano, F.J., Rodríguez-Lera, F.J., Gutiérrez-Fernández, A., Guerrero-Higueras, Á.M.: Assessing the individual acquisition of teamwork competence by exploring students’ instant messaging tools use: the WhatsApp case study. Univ. Access Inf. Soc. 20(3), 441–450 (2020). https://doi.org/10.1007/s10209-020-00772-1

    Article  Google Scholar 

  16. Conde, M.Á., Rodríguez-Sedano, F.J., Fernández, C., Gutiérrez-Fernández, A., Fernández-Robles, L., Limas, M.C.: A learning analytics tool for the analysis of students’ telegram messages in the context of teamwork virtual activities. In: Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, pp. 719–724. Association for Computing Machinery, Salamanca (2020). https://doi.org/10.1145/3434780.3436601

  17. Álvarez-Arana, A., Villamañe-Gironés, M., Larrañaga-Olagaray, M.: Improving assessment using visual learning analytics. Educ. Knowl. Soc. 21, 1–9 (2020)

    Google Scholar 

  18. Ferguson, R.: Learning analytics: drivers, developments and challenges. Int. J. Technol. Enhanced Learn. 4, 304–317 (2012)

    Article  Google Scholar 

  19. Siemens, G.: Learning analytics the emergence of a discipline. Am. Behav. Sci. 57, 1380–1400 (2013)

    Article  Google Scholar 

  20. Few, S.: Information Dashboard Design: Displaying Data for At-a-Glance Monitoring. Analytics Press (2013)

    Google Scholar 

  21. Vázquez-Ingelmo, A., Garcia-Peñalvo, F.J., Therón, R.: Information dashboards and tailoring capabilities - a systematic literature review. IEEE Access 7, 109673–109688 (2019)

    Article  Google Scholar 

  22. Sein-Echaluce, M.L., Fidalgo-Blanco, Á., Esteban-Escaño, J., García-Peñalvo, F.J., Conde, M.Á.: Using learning analytics to detect authentic leadership characteristics at engineering degrees. I. Int. J. Eng. Educ. 34, 851–864 (2018)

    Google Scholar 

  23. Tasa, K., Taggar, S., Seijts, G.H.: The development of collective efficacy in teams: a multilevel and longitudinal perspective. J. Appl. Psychol. 92, 17–27 (2007)

    Article  Google Scholar 

  24. Chowdhury, G.: Natural language processing. Ann. Rev. Inf. Sci. Technol., 51–89 (2003)

    Google Scholar 

  25. McNamara, D.S., Allen, L., Crossley, S., Dascalu, M., Perret, C.A.: Natural language processing and learning analytics. In: Handbook of Learning Analytics, vol. 93 (2017)

    Google Scholar 

  26. Allen, L.K., Jacovina, M.E., McNamara, D.S.: Computer-Based Writing Instruction. Grantee Submission (2016)

    Google Scholar 

  27. Graesser, A.C., et al.: AutoTutor: a tutor with dialogue in natural language. Behav. Res. Methods Instrum. Comput. 36, 180–192 (2004)

    Article  Google Scholar 

  28. Koller, D., Ng, A., Chen, Z.: Retention and intention in massive open online courses: in depth. EDUCAUSE Review (2013). https://er.educause.edu/articles/2013/6/retention-and-intention-in-massive-open-online-courses-in-depth

  29. Stahl, G.: Group Cognition: Computer Support for Building Collaborative Knowledge (Acting with Technology). The MIT Press (2006)

    Google Scholar 

  30. Dong, A.: The latent semantic approach to studying design team communication. Des. Stud. 26, 445–461 (2005)

    Article  Google Scholar 

  31. Alblawi, A.S., Alhamed, A.A.: Big data and learning analytics in higher education: demystifying variety, acquisition, storage, NLP and analytics. In: Conference Big Data and Learning Analytics in Higher Education: Demystifying Variety, Acquisition, Storage, NLP and Analytics, pp. 124–129. IEEE (2018)

    Google Scholar 

  32. Aung, K.Z., Myo, N.N.: Sentiment analysis of students’ comment using lexicon based approach. In: Conference Sentiment Analysis of Students’ Comment Using Lexicon Based Approach, pp. 149–154. IEEE (2017)

    Google Scholar 

  33. Austin, J.L., Austin, J.L., Urmson, J.O., Urmson, J.O., Sbisà, M.: How to Do Things with Words, 2nd edn. Harvard University Press (1975)

    Google Scholar 

  34. Erkens, G., Janssen, J.: Automatic coding of dialogue acts in collaboration protocols. Int. J. Comput.-Support. Collab. Learn. 3, 447–470 (2008)

    Article  Google Scholar 

  35. Nistor, N., et al.: Finding student-centered open learning environments on the internet: automated dialogue assessment in academic virtual communities of practice. Comput. Hum. Behav. 47, 119–127 (2015)

    Article  Google Scholar 

  36. Liddo, A.D., Shum, S.B., Quinto, I., Bachler, M., Cannavacciuolo, L.: Discourse-centric learning analytics. In: Proceedings of the 1st International Conference on Learning Analytics and Knowledge, pp. 23–33. Association for Computing Machinery, Banff (2011). https://doi.org/10.1145/2090116.2090120

  37. Praharaj, S., Scheffel, M., Schmitz, M., Specht, M., Drachsler, H.: Towards automatic collaboration analytics for group speech data using learning analytics. Sensors 21, 3156 (2021)

    Article  Google Scholar 

  38. Misra, A., Walker, M.: Topic independent identification of agreement and disagreement in social media dialogue. arXiv preprint arXiv:1709.00661 (2017)

  39. sentiment-analysis-Spanish 0.0.25 Python Software Foundation. https://pypi.org/project/sentiment-analysis-spanish/. Accessed 17 Feb 2022

  40. Natural Language Toolkit 3.7. https://www.nltk.org/. Accessed 17 Feb 2022

  41. Dash Enterprise. https://plotly.com/. Accessed 17 Feb 2022

Download references

Author information

Authors and Affiliations

  1. Department of Mechanics, Computer Science and Aerospace Engineering, Robotics Group, Universidad de León, Campus de Vegazana S/N, 24071, León, Spain

    Miguel Á. Conde & Camino Fernández-Llamas

  2. School of Mechanical, Computer Science and Aerospace Engineering, Universidad de León, Campus de Vegazana SN, 24071, León, Spain

    Adrián Andrés-Gómez

  3. Department of Electric, Systems and Automatics Engineering, Robotics Group, Universidad de León, Campus de Vegazana S/N, 24071, León, Spain

    Francisco J. Rodríguez-Sedano

Authors
  1. Miguel Á. Conde
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Adrián Andrés-Gómez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Francisco J. Rodríguez-Sedano
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Camino Fernández-Llamas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miguel Á. Conde .

Editor information

Editors and Affiliations

  1. Department of Multimedia and Graphic Art, Cyprus University of Technology, Limassol, Cyprus

    Panayiotis Zaphiris

  2. Research Center on Interactive Media, Smart Systems and Emerging Technologies (CYENS), Cyprus University of Technology, Limassol, Cyprus

    Andri Ioannou

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Conde, M.Á., Andrés-Gómez, A., Rodríguez-Sedano, F.J., Fernández-Llamas, C. (2022). Applying Natural Language Processing to Teamwork – A New Dashboard for CTMTC Methodology. In: Zaphiris, P., Ioannou, A. (eds) Learning and Collaboration Technologies. Novel Technological Environments. HCII 2022. Lecture Notes in Computer Science, vol 13329. Springer, Cham. https://doi.org/10.1007/978-3-031-05675-8_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05675-8_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05674-1

  • Online ISBN: 978-3-031-05675-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation