Skip to main content

Advertisement

Log in

Towards automated e-counselling system based on counsellors emotion perception

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

Emotions are a core semantic component of human communication. Since counsellors are humans we assume that their own state of emotions could affect their intuitional effort when taking decisions concerning their clients. Therefore, the accuracy of detected emotions by counsellors could be doubtful. And this highlights the need for complementing the intuitional effort of counsellors by computational approach. Therefore, ascertaining the efficacy of computational algorithm, there is the need to benchmark with humans. In this paper, we explore empirically, the extent to which counsellors own emotional states influence their perception of emotions expressed in text. This influence is investigated through the level of agreement among counsellors when annotating emotions expressed in students’ personal life’s stories. The result shows strong intra-counsellor annotation agreement of emotions while inter-counsellors annotation agreement was low. Furthermore, the intra-annotation agreement of emotions was found to be strongly correlated to the counsellors’ self-reported emotions. We speculate, based on the findings, that the emotional state of counsellors influences their emotion perception while tracking emotions in text. Based on the results, we discuss the advantages of using an automated e-counselling system for emotion analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. Blog post of some deviant attitude of students in Ghana: http://savannahnewsblogspotcom.blogspot.com/2015/09/students-indiscipline-due-to-use-of.html

  2. GATE: https://gate.ac.uk /

  3. Annotea: https:// www.w3.org/2001/Annotea/

  4. http://www.helsinki.fi/varieng/CoRD/corpora/HelsinkiCorpus/

  5. http://www.natcorp.ox.ac.uk /

  6. Instance of a class (thus text corpus) is the representation of each sentences or paragraphs depending on how it is pre-processed for analysis or classification (see http://www.slideshare.net/dataminingtools/weka-data-mining-input-concepts-instances-and-attributes )

  7. Geertzen inter-rater agreement with multiple raters and variables software here: https://nlp-ml.io/jg/software/ira/

References

  • Acerbi, A., Lampos, V., Garnett, P., Bentley, R. A. (2013). The expression of emotions in 20th century books. PLoS one, 8(3), e59030.

  • Aman, S., & Szpakowicz, S. (2007). Identifying expressions of emotion in text. In: International Conference on Text, Speech and Dialogue (pp. 196–205), Springer Berlin Heidelberg.

  • Artstein, R., & Poesio, M. (2008). Inter-coder agreement for computational linguistics. Computational Linguistics, 34(4), 555–596.

    Article  Google Scholar 

  • Bahadir M. (2012). Virtual guidance. Institute of Educational sciences (pp. 66-69), Bucharest.

  • Balahur, A., Hermida, J.M., & Montoyo, A. (2011). Detecting implicit expressions of sentiment in text based on common-sense knowledge. In 2nd Workshop on Computational Approaches to Subjectivity and Sentiment Analysis (pp. 53–60), ACL-HLT 2011.

  • Bishop, C. (2006). Pattern recognition and Machine learning. Information Science and Statistics. New York: Springer-Verlag, 1, 1-738.

  • Boone, R., & Buck, R. (2003). Emotion expressivity and trustworthiness: The role of nonverbal behaviour in the evolution of cooperation. Journal of Nonverbal Behavior, 27, 163–182.

    Article  Google Scholar 

  • Canales, L., & Martínez-Barco, P. (2014). Emotion detection from text: A survey. In Proceedings of the 5th information systems research. (pp. 30–37).

  • Carle, A. C., Jaffee, D., Miller, D. (2009). Engaging college science students and changing academic achievement with technology: A quasi-experimental preliminary investigation. Computers and Education, 52(2), 376–380.

  • Carletta, J. (1996). Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics, 22(2), 249–254.

    Google Scholar 

  • Cohen, J. (1960). Coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.

    Article  MathSciNet  Google Scholar 

  • Conger, A. J. (1980). Integration and generalization of kappas for multiple raters. Psychological Bulletin, 88, 322–328.

    Article  Google Scholar 

  • Crowston, K., Liu, X., Allen, E., Heckman, R. (2010). Machine learning and rule-based automated coding of qualitative data. In Proceedings of 2010 ASIST Conference, Pittsburgh.

  • D’Melo, M., Carnevale, P. J., & Gratch, J. (2014). Reading people’s minds from emotion expressions in interdependent decision making. Journal of Personality and Social Psychology, 106(1), 73–88.

    Article  Google Scholar 

  • Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6, 169–200.

    Article  Google Scholar 

  • Ekman, P. (2007). Emotions revealed: Recognizing faces and feelings to improve communication and emotional life. New York: Holt.

    Google Scholar 

  • Esbroeck, V.R. (2008). Career guidance in a global world. International handbook of career guidance. In Athanasou J.A., Van Esbroeck R. (eds) International Handbook of Career Guidance (pp. 23–44). Dordrecht: Springer.

  • Essuman, J. K. (2007). A review of educational studies (1983-1997) in guidance and counselling in schools in Ghana. Ghana Journal of Psychology, 1(1), 72–88.

    Google Scholar 

  • Ezhilarasi, R., & Minu, R.I. (2012). Automatic emotion recognition and classification. Procedia Engineering, Elsevier. Vol. 38, pp. 21–26.

  • Fang, X., & Zhan, J. (2015). Sentiment analysis using product review data. Journal of Big Data, 2(5), 1–14.

    Google Scholar 

  • Flammia, G., & Zue, V. (1995). Empirical evaluation of human performance and agreement in parsing discourse constituents in spoken dialogue. In Proceedings of the 4th European Conference on Speech Communication and Technology, (volume 3, pp. 1965–1968). Madrid, Spain.

  • Fleiss, J. L. (1971). Measuring nornimal scale agreement among many raters. Psychological Bulletin, 76, 378–382.

    Article  Google Scholar 

  • Frank, R. (2004) Introducing moral emotions into models of rational choice feelings and emotions. In Manstead, A., Frijda, M. and Fischer, A., eds. (pp. 422-440), New York, Cambridge University Press.

  • Geertzen, J. (2012). Inter-Rater Agreement with multiple raters and variables. https://nlpml.io/jg/software/ira/. Accessed 5 September 2017.

  • Glasheen, K., Campbell, M. A., & Shochet, I. (2013). Opportunities and challenges: School guidance Counsellors’ perceptions of Counselling students online. Australian Journal of Guidance and Counselling, 23, 222–235. https://doi.org/10.1017/jgc.2013.15.

    Article  Google Scholar 

  • Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I. H. (2009). The WEKA data mining software: an update. ACM SIGKDD Explorations Newsletter, 11(1), 10–18.

  • Huang, T. C. K., Huang, C. H., & Chuang, Y. T. (2016). Change discovery of learning performance in dynamic educational environments. Telematics and Informatics, 33(3), 773–792.

    Article  Google Scholar 

  • Keltner, D., Oatley, K., & Jenkins, J. M. (2014). Understanding emotions. Hoboken: Wiley.

    Google Scholar 

  • Kevor, M. O. (2013). E-Counselling for institution of higher learning in Ghana: What are the requirements? International Journal of research in Computer Application and Management, 3(5), 131–134.

    Google Scholar 

  • Kim, Y., & Provost, E. M. (2015). Leveraging inter-rater agreement for audio-visual emotion recognition. In Proceedings of IEEE International Conference on Affective Computing and Intelligent Interaction (pp. 553-559).

  • King, V. L., Brooner, R. K., Peirce, J. M., Kolodner, K., & Kidorf, M. S. (2014). A randomized trial of web-based videoconferencing for substance abuse counseling. Journal of Substance Abuse Treatment, 46(1). https://doi.org/10.1016/j.jsat.2013.08.009.

  • Kolachina, A. (2014). Impact of emotional intelligence on academic achievements of expatriate college students in Dubai. International Journal of Social Science and Humanities Research, 2(2), 97–103.

    Google Scholar 

  • Kolog, E. A., Sutinen, E., & Vanhalakka-Ruoho, M. (2014). E-counselling implementation: Students’ life stories and counselling technologies in perspective. International Journal of Education and Development using Information and Communication Technology, 10(3), 32–48.

    Google Scholar 

  • Kolog, E. A., Sutinen, E., Vanhalakka-Ruoho, M., Suhonen, J., & Anohah, E. (2015a). Using unified theory of acceptance and use of technology model to predict Students' Behavioural intention to adopt and use E-Counselling in Ghana. International Journal of Modern Education and Computer Science, 7(11), 1–11.

    Article  Google Scholar 

  • Kolog, E.A., Sutinen, E., Vanhalakka-Ruoho, M. Suhonen, J., Anohah, E. (2015b). Towards students’ behavioural intention to adopt and use e-counselling: An empirical approach of using unified theory of acceptance and use of technology model. In IEEE AFRICON, 1–6 (2015).

  • Kolog, E.A., Sutinen, E., Vanhalakka-Ruoho, M. Suhonen, J. & Anohah, E. (2016) Annotation agreement of emotions in text: The influence of counselors' emotional state on their emotion perception. In Proceedings of 16th IEEE International conference on Advanced Learning Technologies in Austin, Texas (pp. 357-359).

  • Krippendoff, K. (1967). Content analysis: An introduction to its methodology. Beverly Hills: Sage Publications.

    Google Scholar 

  • Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.

    Article  MATH  Google Scholar 

  • Lee, S.Y.M., Chen, Y., Huang, C.R. (2010). A text-driven rule-based system for emotion cause detection. In Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text. Association for Computational Linguistics (pp. 45-53).

  • Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgement and choice. Cognition & Emotion, 14(4), 473–493.

    Article  Google Scholar 

  • Loewenstein, G., Weber, E. U., Hsee, C. K., & Welch, N. (2001). Risk as feelings. Psychological Bulletin, 127, 267–286.

    Article  Google Scholar 

  • Lowenstein, G., & Lerner, J. (2003). The role of affect in decision making. (K. S. In R. Davidson (Ed.). New York: Oxford University Press pp. 619–642.

  • Lugmayr, A., Sutinen E., Suhonen, J., Sedano, C.I., Hlavacs and Montero C.S. (2016). Serious storytelling – a first definition and review, Multimedia Tools and Applications, pp. 1–27, doi:https://doi.org/10.1007/s11042-016-3865-5

  • Mulcrone, K. (2012). Detecting Emotion in Text. University of Minnesota–Morris CS Senior Semminar Paper. Available from https://s3.eddieoz.com/docs/sentiment_analysis/Detecting_Emotion_in_Text.pdf. Accessed 24 October 2016.

  • Munezero, M., Montero, C.S., Mozgovoy, M., Sutinen, E. (2013a). Exploiting sentiment analysis to track emotions in students' learning diaries. In Proceedings of the 13th Koli Calling International Conference on Computing Education Research (pp. 145-152). New York: ACM.

  • Munezero, M., Mozgovoy, M., Kakkonen, T., Klyuev, V., & Sutinen, E. (2013b). Antisocial behaviour corpus for harmful language detection. Proceedings of Federated Conference on Computer Science and Information Systems. pp. 261–265.

  • NERIC (2007). Education Reform 2007 at a glance. Available from http://planipolis.iiep.unesco.org/upload/Ghana/Ghana_education_reform_2007.pdf>. Accessed 4 Aug 2013.

  • Norbert, S. (2000). Emotion, cognition, and decision making. Cognition & Emotion, 14(4), 433–440.

    Article  Google Scholar 

  • Paulus, M. P., & Yu, A. J. (2012). Emotion and decision-making: Affect-driven belief systems in anxiety and depression. Trends in Cognitive Sciences, 16(9), 476–483. https://doi.org/10.1016/j.tics.2012.07.009.

    Article  Google Scholar 

  • Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91–106.

    Article  Google Scholar 

  • Plutchik, R. (1980), Emotion: Theory, research, and experience: Theories of emotion. New York: Academic. Vol. 1, 399 pages.

  • Raghunathan, R., & Pham, M. T. (1999). All negative moods are not equal: Motivational influences of anxiety and sadness on decision making. Organizational Behavior and Human Decision Processes, 79(1), 56–77.

    Article  Google Scholar 

  • Savickas, M. L., Nota, L., Rossier, J., Dauwalder, J. P., Duarte, M. E., Guichar, J., Soresi, S., Esbroeck, R. V., & Viane, A. E. M. (2009). Life designing: A paradigm for career construction in the 21st century. Journal of Vocational Behavior, 75, 239–250.

    Article  Google Scholar 

  • Scherer, K. R., & Wallbott, H. G. (1994). Evidence for universality and cultural variation of differential emotion response patterning. Journal of Personality and Social Psychology, l(66), 310–328.

    Article  Google Scholar 

  • Sedofia, J., & Ocancy, F. (2003). An evaluation of the information and consultation services in the colleges of education in the Volta region of Ghana. Educational Research, 4(1), 674–681.

    Google Scholar 

  • Shelke, M. (2014). Approaches of emotion detection from text. International Journal of Computer Science and Information Technology, 2, 123–128.

    Google Scholar 

  • Shivhare, S. N., & Saritha, K. (2012). Emotion detection from text. arXiv preprint arXiv:1205.4944. Available from https://airccj.org/CSCP/vol2/csit2237.pdf. Accessed 23 September 2016.

  • Strapparava, C., & Mihalcea, R. (2008). Learning to identify emotions in text. In Proceedings of the 2008 ACM Symposium on Applied Computing (pp. 1556-1560). New York: ACM

  • Truong, K. P., Neerincx, M. A., & Leeuwen, D. A. V. (2008). Assessing agreement of observer- and self-annotations in spontaneous multimodal emotion data (pp. 318–321). Brisbane: Inter-speech conference.

    Google Scholar 

  • Vinluan, L. V. (2011). The use of ICT in school guidance: Attitudes and practices of guidance in metro manila, the Philipines. International Journal for the Advancement of Counselling, 33, 22–36. https://doi.org/10.1007/S10447-010-9110-4.

    Article  Google Scholar 

  • Volkova, E. P. Mohler, B. J. Meurers, D., Gerdemann, D., & Buultho, H. H. (2010). Emotional perception of fairy tales: Achieving agreement in emotion annotation of text. Proceedings of the NAACL HLT Workshop on Computational Approaches to Analysis and Generation of Emotion in Text (pp. 98–106).

  • Wang, X., & Zheng, Q. (2013). Text emotion classification research based on improved latent semantic analysis algorithm. In Proceedings of the 2nd international conference on computer science and electronics engineering (ICCSEE 2013), number Iccsee (pp. 210–213). Paris: Atlantis Press.

    Google Scholar 

  • Webb, M. E. (2006). ICT and classroom management. In M. Lleask & N. Pachler (Eds.), Learning to teach using ICT in the secondary school: A companion to school experience (pp. 41–60). London: Routledge.

    Google Scholar 

  • Weng, C.H., & Yang, Y.T.C. (2009). A successful technology integration in schools to improve the effectiveness of elementary school administration. In EdMedia: World Conference on Educational Media and Technology (pp. 1098-1115). Association for the Advancement of Computing in Education (AACE).

  • Wiebe, J., Wilson, T., & Cardie, C. (2005). Annotating expressions of opinions and emotions in language. Language Resources and Evaluation, 39(2), 165–210.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Emmanuel Awuni Kolog.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kolog, E.A., Montero, C.S. Towards automated e-counselling system based on counsellors emotion perception. Educ Inf Technol 23, 911–933 (2018). https://doi.org/10.1007/s10639-017-9643-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-017-9643-9

Keywords

Navigation