Skip to main content
SpringerLink
Log in

ML-based intelligent real-time feedback system for blended classroom

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

The application of machine learning (ML) has grown and is now used to enhance learning outcomes. In blended classroom settings, ML, emerging smartphones and wearable technologies are commonly used to improve teaching and learning. The combination of these advanced technologies and ML plays a crucial role in enhancing real-time feedback quality. However, there are abundant scopes of improvement and strong need for further careful investigations in this area. We propose an ML-based intelligent real-time feedback system to address current research challenges for blended classrooms. The proposed system provides real-time feedback to students and teachers. We build an Android application for our intelligent feedback interfaces. The user interfaces use students’ academic performance prediction models with real-time states and dynamic feedback timings based on historic feedback statistics. In addition, the feedback scheduling algorithms, choices of peripheral devices for real-time feedback, and feedback modalities to optimize fatigue make our system interfaces intelligent and novel. The end users well-received the intelligent features and technology of the proposed system. Our empirical findings indicate that unique design elements, such as dynamic timing, choice of peripheral devices, and modalities of real-time feedback, are crucial in integrating the system with blended classes. The intelligent characteristics of the proposed system have been appreciated by a large proportion of the end-users (90.90% of teachers and 84.21% of students) for use in real-time blended classroom environments. The higher comparative system usability scale (SUS) scores with benchmarks show real promise of the system design.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References  

  • Adam, N. R., Shafiq, B., & Staffin, R. (2012). Spatial computing and social media in the context of disaster management. IEEE Intelligent Systems, 27(6), 90–96. https://doi.org/10.1109/TLT.2014.2383611

    Article  Google Scholar 

  • Albert, B., & Tullis, T. (2013). Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes.

    Google Scholar 

  • Aldowah, H., & Al-Samarraie, H. (2019). W M Fauzy 2019 Educational data mining and learning analytics for 21stcentury higher education: A review and synthesis. Telematics and Informatics, 37, 13–49. https://doi.org/10.1016/j.tele.2019.01.007

    Article  Google Scholar 

  • Augusto, J.C., Nakashima, H., Aghajan, H. (2010). Ambient intelligence and smart environments: A state of the art. In: Nakashima, H., Aghajan, H., Augusto, J.C. (eds) Handbook of Ambient Intelligence and Smart Environments. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-93808-0_1

  • Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual sus scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3), 114–123. https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Bangor_May2009.pdf.

    Google Scholar 

  • Batool, S., Rashid, J., Nisar, M. W., Kim, J., Kwon, H.-Y., & Hussain, A. (2023). (2023) Educational data mining to predict students’ academic performance: A survey study. Education and Information Technologies, 28(1), 905–971. https://doi.org/10.1007/s10639-022-11152-y

    Article  Google Scholar 

  • Bhattacharya, S., Shah, V. B., Kumar, K., & Biswas, U. (2021). A real-time interactive visualizer for large classroom. ACM Transactions on Interactive Intelligent Systems (TiiS), 11(1), 1–26. https://doi.org/10.1145/3418529

    Article  CAS  Google Scholar 

  • Biswas, U., & Bhattacharya, S., (2022). Multimodal peripheral alert to improve teaching-learning for blended classroom. In ICT Analysis and Applications: Proceedings of ICT4SD 2022, pages 703–713. Springer.

  • Boucek, G.P. Jr., Veitengrubber, J.E., & Smith, W.D (1977) Aircraft alerting systems criteria study. Volume II. Human factors guidelines for aircraft alerting systems. BOEING COMMERCIAL AIRPLANE CO SEATTLE WA. https://apps.dtic.mil/sti/pdfs/ADA043383.pdf

  • Braun, M. C., Beuck, S., Wölfel, M., & Scheurer, A. (2018). Investigating multimodal warnings for distracted smartphone users on the move in potentially dangerous situations. Transactions on Computational Science XXXII (pp. 1–14). Springer.

    Google Scholar 

  • Choudhury, N., Tamarapalli, V., & Bhattacharya, S. (2015). An ict-based system to improve the learning experience in a large classroom. 2015 IEEE Seventh International Conference on Technology for Education (T4E) (pp. 27–30). IEEE. https://doi.org/10.1109/T4E.2015.1

    Chapter  Google Scholar 

  • Choudhury, N., Venkatesh, T., Bhattacharya, S., & Sarma, S. (2016). Avabodhaka: a system to analyse and facilitate interactive learning in an ict based system for large classroom. Procedia Computer Science, 84, 160–168. https://doi.org/10.1016/j.procs.2016.04.082

    Article  Google Scholar 

  • Fahd, K., Venkatraman, S., Miah, S. J., et al. (2022). Application of machine learning in higher education to assess student academic performance, at-risk, and attrition: A meta-analysis of literature. Education and Information Technologies, 27, 3743–3775. https://doi.org/10.1007/s10639-021-10741-7

  • Fernández-Delgado, M., Mucientes, M., Vázquez-Barreiros, B., & Lama, M. (2014). Learning analytics for the prediction of the educational objectives achievement. 2014 IEEE Frontiers in Education Conference (FIE) Proceedings (pp. 1–4). IEEE. https://doi.org/10.1109/FIE.2014.7044402

    Chapter  Google Scholar 

  • Fortin, P.E. (2019) Methods and interfaces for closed loop smartphone notifications. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, (pages 1–5). https://doi.org/10.1145/3338286.3344422

  • Ge, X., Liu, J., Qi, Q., & Chen, Z. (2011). A new prediction approach based on linear regression for collaborative filtering. 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) (Vol. 4, pp. 2586–2590). IEEE. https://doi.org/10.1109/FSKD.2011.6020007

    Chapter  Google Scholar 

  • Hellas, A., Ihantola, P., Petersen, A., Ajanovski, V.V., Gutica, M., Hynninen, T., Knutas, A., Leinonen, J., Messom, Chris., Liao, S.N. (2018) Predicting academic performance: a systematic literature review. In Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, (pages 175–199). https://doi.org/10.1145/3293881.3295783

  • Holstein, K., McLaren, B.M., & Aleven V. (2017). Intelligent tutors as teachers’ aides: exploring teacher needs for real-time analytics in blended classrooms. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference, (pages 257–266). https://doi.org/10.1145/3027385.3027451

  • Holstein, K., McLaren, B.M., Aleven, V. (2019). Designing for Complementarity: Teacher and Student Needs for Orchestration Support in AI-Enhanced Classrooms. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds) Artificial Intelligence in Education. AIED 2019. Lecture Notes in Computer Science, 11625. https://doi.org/10.1007/978-3-030-23204-7_14

  • Keser, S. B., & Aghalarova, S. (2022). Hela: A novel hybrid ensemble learning algorithm for predicting academic performance of students. Education and Information Technologies, 27(4), 4521–4552. https://doi.org/10.1007/s10639-021-10780-0

    Article  Google Scholar 

  • Ketabdar, H., Moghadam, P., & Roshandel, M. (2012). Pingu: A new miniature wearable device for ubiquitous computing environments. 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems (pp. 502–506). IEEE.

    Chapter  Google Scholar 

  • Kumar S (2014). Ubiquitous smart home system using android application. Academy and Industry Research Collaboration Center (AIRCC). International Journal of Computer Networks & Communications, 6(1), 33–43. https://doi.org/10.5121/ijcnc.2014.6103

  • Kushlev, K., Proulx, J., & Dunn EW (2016). Silence your phones, smartphone notifications increase inattention and hyperactivity symptoms. In Proceedings of the 2016 CHI conference on human factors in computing systems, (pages 1011–1020). https://doi.org/10.1145/2858036.2858359

  • Márquez-Vera, C., Cano, A., Romero, C., Noaman, A. Y. M., MousaFardoun, H., & Ventura, S. (2016). Early dropout prediction using data mining: a case study with high school students. Expert Systems, 33(1), 107–124. https://doi.org/10.1111/exsy.12135

    Article  Google Scholar 

  • Marshall, D. C., Lee, J. D., & Austria, P. A. (2007). Alerts for in-vehicle information systems: Annoyance, urgency, and appropriateness. Human factors, 49(1), 145–157. https://doi.org/10.1518/001872007779598145

    Article  PubMed  Google Scholar 

  • Marshall, E., & Baker, S., (1995). Alarms in nuclear power plant control rooms: current approaches and future design. In Human factors in alarm design, (pages 183–191). https://doi.org/10.5555/212905.212916

  • Martinez-Maldonado, R., Clayphan, A., Yacef, K., & Kay, J. (2014). Mtfeedback: Providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Transactions on Learning Technologies, 8(2), 187–200. https://doi.org/10.1109/TLT.2014.2365027

    Article  Google Scholar 

  • Mathioudakis, G., Leonidis, A., Korozi, M., Margetis, G., Ntoa, S., Antona, M., & Stephanidis, C. (2014). Real-time teacher assistance in technologically-augmented smart classrooms. International Journal of Advanced Life Sciences, 6(1), 62–73.

    Google Scholar 

  • Meredith, C., & Edworthy, J. (1995). Are there too many alarms in the intensive care unit? an overview of the problems. Journal of Advanced Nursing, 21(1), 15–20. https://doi.org/10.1046/j.1365-2648.1995.21010015.x

    Article  CAS  PubMed  Google Scholar 

  • Pece, F., Zarate, J.J., Vechev, V., Besse, N., Gudozhnik, O., Shea H., Hilliges, O., (2017). Magtics: Flexible and thin form factor magnetic actuators for dynamic and wearable haptic feedback. In Proceedings of the 30th annual ACM symposium on User interface software and technology, (pages 143–154). https://doi.org/10.1145/3126594.3126609

  • Rastrollo-Guerrero, J. L., Gómez-Pulido, J. A., & Durán-Domnguez, A. (2020). Analyzing and predicting students performance by means of machine learning: A review. Applied Sciences, 10(3), 1042. https://doi.org/10.3390/app10031042

    Article  Google Scholar 

  • Rovira, S., Puertas, E., & Igual, L. (2017). Data-driven system to predict academic grades and dropout. PLoS one, 12(2), 207. https://doi.org/10.1371/journal.pone.0171207

    Article  CAS  Google Scholar 

  • Saikia, M. S. I., Kumar, P., Bhattacharya, S., & Tamarapalli, V. (2016). Estimating attention and understanding level of students in a large classroom environment. In 2016 IEEE Eighth International Conference on Technology for Education (T4E), (pages 128–131). https://doi.org/10.1109/T4E.2016.033

  • Singley, M.K., & Lam, R.B., (2005).The classroom sentinel: supporting data-driven decision-making in the classroom. In Proceedings of the 14th international conference on World Wide Web, (pages 315–321). https://doi.org/10.1145/1060745.1060793

  • Srivastava, K., & Dey, S. (2018). Role of digital technology in teaching-learning process. IOSR Journal Of Humanities And Social Science (IOSR-JHSS), 23(1), 74–79. https://sadbhavnaresearchjournal.com/wp-content/uploads/2022/08/03Mr.-B.-Babu-Pg-20-31.pdf..

    Google Scholar 

  • Sweeney, Mack, Lester, Jaime, Rangwala, Huzefa, & Johri, Aditya. (2016). Next-Term Student Performance Prediction: A Recommender Systems Approach. Journal of Educational Data Mining, 8(1), 22–51. https://doi.org/10.5281/zenodo.3554604

  • Tabuenca, B., Kalz, M., Ternier, S., & Specht, M. (2014). Stop and think: Exploring mobile notifications to foster reflective practice on meta-learning. IEEE Transactions on Learning Technologies, 8(1), 124–135. https://doi.org/10.1109/TLT.2014.2383611

    Article  Google Scholar 

  • Talwar, J., Ranjani, S., Aras A., & Bedekar M.(2013) Intelligent classroom system for qualitative analysis of students’ conceptual understanding. In 2013 6th International Conference on Emerging Trends in Engineering and Technology, (pages 25–290. https://doi.org/10.1109/ICETET.2013.6

  • Tang, Y., Liang, J., Hare, R., & Wang, F.-Y. (2020). A personalized learning system for parallel intelligent education. IEEE Transactions on Computational Social Systems, 7(2), 352–361. https://doi.org/10.1109/TCSS.2020.2965198

    Article  Google Scholar 

  • Tikadar, S., Bhattacharya, S., (2021). Detection of affective states of the students in a blended learning environment comprising of smartphones. International Journal of Human–Computer Interaction, 37(10), 963-980. https://doi.org/10.1080/10447318.2020.1861762

  • Tikadar, S., Bhattacharya, S., & Tamarapalli, V., (2018). A blended learning platform to improve teaching-learning experience. In 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), (pages 87–89). IEEE, https://doi.org/10.1109/ICALT.2018.00027

  • Tikadar, S., (2021). Vedinkaksha: A Computational Framework for a ‘Sensitive’Blended Learning Platform. Phd thesis, Indian Institute of Technology Guwahati, 2021. Available at http://gyan.iitg.ac.in/handle/123456789/2035.

  • Tullis, T., & Albert, W. (2013). Measuring the User Experience, Second Edition: Collecting, Analyzing, and Presenting Usability Metrics (2nd ed.). Morgan Kaufmann Publishers Inc.

    Google Scholar 

  • Verweij, D., Bakker S., & Eggen, Berry., (2017). Fireflies2: Interactive tangible pixels to enable distributed cognition in classroom technologies. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces, (pages 260–269). ACM, https://doi.org/10.1145/3132272.3134122.

  • Wang., Z, Zhu, C., Ying Z., Zhang, Y., Wang, B., Jin, X., & Yang, H., (2018). Design and implementation of early warning system based on educational big data. In 2018 5th International Conference on Systems and Informatics (ICSAI), (pages 549–553). IEEE. https://doi.org/10.1109/ICSAI.2018.8599357

  • Winters, B. D., Cvach, M. M., Bonafide, C. P., Hu, X., Konkani, A., O’connor, M. F., Rothschild, J. M., Selby, N. M., Pelter, M. M., McLean, B., et al. (2018). Technological distractions (part 2): a summary of approaches to manage clinical alarms with intent to reduce alarm fatigue. Critical care medicine, 46(1), 130–137. https://doi.org/10.1097/CCM.0000000000002803

    Article  PubMed  Google Scholar 

  • Yürür, Ö., Liu, C. H., & Moreno, W. (2015). Light-weight online unsupervised posture detection by smartphone accelerometer. IEEE Internet of Things Journal, 2(4), 329–339. https://doi.org/10.1109/JIOT.2015.2404929

    Article  Google Scholar 

  • Yusof, R. J. R., Qazi, A., & Inayat, I. (2017). Student real-time visualization system in classroom using rfid based on utaut model. The International Journal of Information and Learning Technology. https://doi.org/10.1108/IJILT-03-2017-0018/full/pdf

    Article  Google Scholar 

  • Zagouras, C., Egarchou, D., Skiniotis, P., et al. (2022). Face to face or blended learning? A case study: Teacher training in the pedagogical use of ICT. Education and Information Technologies, 27, 12939–12967. https://doi.org/10.1007/s10639-022-11144-y

Download references

Author information

Authors and Affiliations

  1. Research Scholar, User Centric Computing & Networking Lab, Department of Computer Science and Engineering, Indian Institute of Technology Guwahati, Guwahati, Assam, 781039, India

    Ujjwal Biswas & Samit Bhattacharya

Authors
  1. Ujjwal Biswas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Samit Bhattacharya
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Both authors contributed to write the final manuscript, discused about the research methods and findings.

Corresponding author

Correspondence to Ujjwal Biswas.

Ethics declarations

Competing interests

The authors affirm that they have no known financial or interpersonal conflicts that would have appeared to have an impact on the research presented in this study.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Biswas, U., Bhattacharya, S. ML-based intelligent real-time feedback system for blended classroom. Educ Inf Technol 29, 3923–3951 (2024). https://doi.org/10.1007/s10639-023-11949-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-023-11949-5

Keywords

Search

Navigation