Skip to main content
SpringerLink
Log in

Modeling Negative Affect Detector of Novice Programming Students Using Keyboard Dynamics and Mouse Behavior

  • Conference paper
  • First Online:
Trends in Artificial Intelligence: PRICAI 2016 Workshops (PRICAI 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10004))

Included in the following conference series:

Abstract

We developed affective models for detecting negative affective states, particularly boredom, confusion, and frustration, among novice programming students learning C++, using keyboard dynamics and/or mouse behavior. The keystroke dynamics are already sufficient to model negative affect detector. However, adding mouse behavior, specifically the distance it travelled along the x-axis, slightly improved the model’s performance. The idle time and typing error are the most notable features that predominantly influence the detection of negative affect. The idle time has the greatest influence in detecting high and fair boredom, while typing error comes before the idle time for low boredom. Conversely, typing error has the highest influence in detecting high and fair confusion, while idle time comes before typing error for low confusion. Though typing error is also the primary indicator of high and fair frustrations, other features are still needed before it is acknowledged as such. Lastly, there is a very slim chance to detect low frustration.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Affect. Encyclopedia of Mental Disorders. http://www.minddisorders.com/A-Br/Affect.html

  2. Psychiatry Clerkship. http://depts.washington.edu/psyclerk/glossary.html

  3. Carlos, C.M., Delos Santos, J.E., Fournier, G., Vea, L.: Towards the development of an intelligent agent for novice programmers through face expression recognition. In: Proceedings of the 13th Philippine Computing Science Congress, pp. 101–106 (2013)

    Google Scholar 

  4. Picard R.W., The Medial Lab – Affective Computing Group: Affective computing. http://affect.media.mit.edu/

  5. Rodrigo, M.M.T., Baker, R.S., Jadud, M.C., Amarra, A.C.M., Dy, T., Espejo-Lahoz, M.B.V., Lim, S.A., Pascua, S.A., Sugay, J.O., Tabanao, E.S.: Affective and behavioral predictors of novice programmer achievement. In: Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE 2009), vol. 41, no. 3, pp. 156–160 (2009). http://doi.acm.org/10.1145/1562877.1562929

  6. Khanna, P., Sasikumar, M.: Recognising emotions from keyboard stroke pattern. Int. J. Comput. Appl. 11(9), 1–5 (2010)

    Google Scholar 

  7. Salmeron-Majadas, S., Santos, O.C., Boticario, J.G.: Exploring indicators from keyboard and mouse interactions to predict the user affective state. In: Educational Data Mining (2014)

    Google Scholar 

  8. Epp, C., Lippold, M., Mandryk, R.L.: Identifying emotional states using keystroke dynamics. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 715–724 (2011)

    Google Scholar 

  9. Tsui, W.H., Lee, P., Hsiao, T.C.: The effect of emotion on keystroke: an experimental study using facial feedback hypothesis. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2870–2873 (2013)

    Google Scholar 

  10. Schuller, B., Rigoll, G., Lang, M.: Emotion recognition in the manual interaction with graphical user interfaces. In: Proceedings of the 2004 IEEE International Conference on Multimedia and Expo (ICME 2004), vol. 2, pp. 1215–1218 (2004). http://dx.doi.org/10.1109/ICME.2004.1394440

  11. Tsoulouhas, G., Georgiou, D., Karakos, A.: Detection of learner’s affective state based on mouse movements. J. Comput. 3(11), 9–18 (2011)

    Google Scholar 

  12. Felipe, D.A.M., Gutierrez, K.I.N., Quiros, E.C.M., Vea, L.A.: Towards the development of intelligent agent for novice C/C++ programmers through affective analysis of event logs. Proc. Int. MultiConf. Eng. Comput. Sci. 1, 511–518 (2012)

    Google Scholar 

  13. Lee, D.: Detecting confusion among novice programmers using BlueJ compile logs. Master’s thesis. Ateneo de Manila University, Quezon City (2011)

    Google Scholar 

  14. Dragon, T., Arroyo, I., Woolf, B.P., Burleson, W., el Kaliouby, R., Eydgahi, H.: Viewing student affect and learning through classroom observation and physical sensors. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 29–39. Springer, Heidelberg (2008). doi:10.1007/978-3-540-69132-7_8

    Chapter  Google Scholar 

  15. Viera, A.J., Garrett, J.M.: Understanding interobserver agreement: the kappa statistic. Fam. Med. 37(5), 360–363 (2005)

    Google Scholar 

  16. Bixler, R., D’Mello, S.: Detecting boredom and engagement during writing with keystroke analysis, task appraisals, and stable traits. In: Proceedings of the International Conference on Intelligent User Interfaces, pp. 225–234 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Mapua Institute of Technology, Makati City, Philippines

    Larry Vea

  2. Ateneo de Manila University, Quezon City, Philippines

    Larry Vea & Ma. Mercedes Rodrigo

Authors
  1. Larry Vea
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ma. Mercedes Rodrigo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Larry Vea .

Editor information

Editors and Affiliations

  1. ISIR, Osaka University, Ibaraki, Osaka, Japan

    Masayuki Numao

  2. Thammasat University, Bangkadi Muang Pathumthani, Thailand

    Thanaruk Theeramunkong

  3. National Electronics and Computer Technology Center, Language and Semantic Technology Lab, Pathum Thani, Thailand

    Thepchai Supnithi

  4. Information Technology, King Mongkut's University of Technology North Bangkok, Bangkok, Thailand

    Mahasak Ketcham

  5. Mahidol University, Bangkok, Thailand

    Narit Hnoohom

  6. Media Technology, King Mongkut's University of Technology Thonburi, Thonburi, Thailand

    Patiyuth Pramkeaw

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Vea, L., Rodrigo, M.M. (2017). Modeling Negative Affect Detector of Novice Programming Students Using Keyboard Dynamics and Mouse Behavior. In: Numao, M., Theeramunkong, T., Supnithi, T., Ketcham, M., Hnoohom, N., Pramkeaw, P. (eds) Trends in Artificial Intelligence: PRICAI 2016 Workshops. PRICAI 2016. Lecture Notes in Computer Science(), vol 10004. Springer, Cham. https://doi.org/10.1007/978-3-319-60675-0_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60675-0_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60674-3

  • Online ISBN: 978-3-319-60675-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation