Skip to main content
SpringerLink
Log in

Personality Traits Inference in the Hybrid Foraging Search Task

  • Conference paper
  • First Online:
Design, User Experience, and Usability (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14032))

Included in the following conference series:

  • 823 Accesses

Abstract

Techniques to predict participants’ personality traits in real-time are not yet developed or well-studied. The objective of the current study was to explore the use of gaze and behavioral metrics and machine learning techniques in a hybrid foraging search task to infer an individual's personality traits to enable personalized interaction. We recruited and collected data from 40 university student participants in a hybrid foraging search task experiment. Specifically, the metrics were extracted from different time window sizes (5s, 10s, 15s, and 20s), which referred to the length of time before the participant stopped searching the current screen. Hierarchical clustering analysis was performed on the personality traits scores to group the participants into three groups, namely neuroticism (47.50%), conscientiousness (25.00%), and agreeableness (27.50%). Machine learning models were trained using the eye-gaze and behavioral metrics as inputs and personality trait groups as labels using well-known algorithms (including random forest (RF), support vector machine (SVM), k- nearest neighbor (kNN), and artificial neural network (ANN)). The results from the machine learning modeling showed that the prediction accuracy increased as the window size increased in general. The highest prediction accuracy (83%) was achieved with the kNN algorithm with a 15s time window. Combining eye-gaze and behavioral metrics as input features usually resulted in a better-performing model compared to using eye-gaze metrics alone (up to 10% improvement in accuracy). The current results can be to implement this approach in a brief game-like activity to infer a user's personality traits to enable subsequent intelligent user interface adaptations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ozer, D.J., Benet-Martinez, V.: Personality and the prediction of consequential outcomes. Annu. Rev. Psychol. 57, 401 (2006)

    Article  Google Scholar 

  2. Bachrach, Y., Kosinski, M., Graepel, T., Kohli, P., Stillwell, D.: Personality and patterns of Facebook usage. In: Proceedings of the 4th Annual ACM Web Science Conference, pp. 24–32 (2012)

    Google Scholar 

  3. Neuberg, S.L., Newsom, J.T.: Personal need for structure: individual differences in the desire for simpler structure. J. Pers. Soc. Psychol. 65(1), 113 (1993)

    Article  Google Scholar 

  4. Perlman, S.B., Morris, J.P., Vander Wyk, B.C., Green, S.R., Doyle, J.L., Pelphrey, K.A.: Individual differences in personality predict how people look at faces. PLoS ONE 4(6), e5952 (2009)

    Article  Google Scholar 

  5. Lambiotte, R., Kosinski, M.: Tracking the digital footprints of personality. Proc. IEEE 102(12), 1934–1939 (2014)

    Article  Google Scholar 

  6. Kosinski, M., Bachrach, Y., Kohli, P., Stillwell, D., Graepel, T.: Manifestations of user personality in website choice and behaviour on online social networks. Mach. Learn. 95(3), 357–380 (2013). https://doi.org/10.1007/s10994-013-5415-y

    Article  MathSciNet  Google Scholar 

  7. Goldberg, L.R.: The structure of phenotypic personality traits. Am. Psychol. 48(1), 26 (1993)

    Article  Google Scholar 

  8. Costa, P.T., McCrae, R.R.: Neo personality inventory-revised (NEO PI-R). Odessa, FL: Psychological Assessment Resources (1992)

    Google Scholar 

  9. Han, S., Huang, H., Tang, Y.: Knowledge of words: an interpretable approach for personality recognition from social media. Knowl.-Based Syst. 194, 105550 (2020)

    Article  Google Scholar 

  10. Al Marouf, A., Hasan, M.K., Mahmud, H.: Comparative analysis of feature selection algorithms for computational personality prediction from social media. IEEE Trans. Comput. Soc. Syst. 7(3), 587–599 (2020)

    Article  Google Scholar 

  11. Gao, N., Shao, W., Salim, F.D.: Predicting personality traits from physical activity intensity. Computer 52(7), 47–56 (2019)

    Article  Google Scholar 

  12. Al-Samarraie, H., Eldenfria, A., Dawoud, H.: The impact of personality traits on users’ information-seeking behavior. Inf. Process. Manage. 53(1), 237–247 (2017)

    Article  Google Scholar 

  13. Hoppe, S., Loetscher, T., Morey, S.A., Bulling, A.: Eye movements during everyday behavior predict personality traits. Front. Hum. Neurosci. 12, 105 (2018)

    Article  Google Scholar 

  14. Butt, A.R., Arsalan, A., Majid, M.: Multimodal personality trait recognition using wearable sensors in response to public speaking. IEEE Sens. J. 20(12), 6532–6541 (2020)

    Article  Google Scholar 

  15. Wache, J.: The secret language of our body: affect and personality recognition using physiological signals. In: Proceedings of the 16th International Conference on Multimodal Interaction, pp. 389–393 (2014)

    Google Scholar 

  16. Wache, J., Subramanian, R., Abadi, M. K., Vieriu, R. L., Sebe, N., Winkler, S.: Implicit user-centric personality recognition based on physiological responses to emotional videos. In: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, 239–246 (2015)

    Google Scholar 

  17. Bhardwaj, H., Tomar, P., Sakalle, A., Bhardwaj, A.: Classification of extraversion and introversion personality trait using electroencephalogram signals. In: Solanki, A., Sharma, S.K., Tarar, S., Tomar, P., Sharma, S., Nayyar, A. (eds.) AIS2C2 2021. CCIS, vol. 1434, pp. 31–39. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-82322-1_3

    Chapter  Google Scholar 

  18. Li, W., et al.: Quantitative personality predictions from a brief EEG recording. IEEE Trans. Affect. Comput. (2022)

    Google Scholar 

  19. Zhao, G., Ge, Y., Shen, B., Wei, X., Wang, H.: Emotion analysis for personality inference from EEG signals. IEEE Trans. Affect. Comput. 9(3), 362–371 (2017)

    Article  Google Scholar 

  20. Kazdin, A.E. (ed.).: Encyclopedia of Psychology, vol. 1–8. Washington, DC: American Psychological Association (2000)

    Google Scholar 

  21. Hogan, J., Ones, D.S.: Conscientiousness and integrity at work. In: Handbook of Personality Psychology. Academic Press, 849–870 (1997)

    Google Scholar 

  22. Rosario, P., Marı́a del, C.E., César Á.: On the relationship between attention and personality: covert visual orienting of attention in anxiety and impulsivity. Personality Individ. Differ. 36(6), 1471–1481 (2004)

    Google Scholar 

  23. Öhman, A., Flykt, A., Esteves, F.: Emotion drives attention: detecting the snake in the grass. J. Exp. Psychol. Gen. 130(3), 466–478 (2001)

    Article  Google Scholar 

  24. Hickey, C., Chelazzi, L., Theeuwes, J.: Reward guides vision when it’s your thing: trait reward-seeking in reward-mediated visual priming. PLoS ONE 5(11), e14087 (2010)

    Article  Google Scholar 

  25. Hickey, C., Peelen, M.V.: Neural mechanisms of incentive salience in naturalistic human vision. Neuron 85(3), 512–518 (2015)

    Article  Google Scholar 

  26. Peltier, C., Becker, M.W.: Individual differences predict low prevalence visual search performance. Cogn. Res.: Principles Implications 2(1), 1–11 (2017). https://doi.org/10.1186/s41235-016-0042-3

    Article  Google Scholar 

  27. Brown, E.T., et al.: Finding waldo: learning about users from their interactions. IEEE Trans. Visual Comput. Graphics 20(12), 1663–1672 (2014)

    Article  Google Scholar 

  28. Judge, T.A., Ilies, R.: Relationship of personality to performance motivation: a meta-analytic review. J. Appl. Psychol. 87(4), 797–807 (2002)

    Article  Google Scholar 

  29. Sen, A.N.I.M.A., Goel, N.: Functional relation between personality types and some impirically derived TSD parameters in a visual searching task. Psychol. Stud. 26, 23–27 (1981)

    Google Scholar 

  30. Biggs, A.T., Mitroff, S.R.: Improving the efficacy of security screening tasks: a review of visual search challenges and ways to mitigate their adverse effects. Appl. Cogn. Psychol. 29(1), 142–148 (2015)

    Article  Google Scholar 

  31. Mitroff, S.R., Biggs, A.T., Cain, M.S.: Multiple-target visual search errors: overview and implications for airport security. Policy Insights Behav. Brain Sci. 2(1), 121–128 (2015)

    Article  Google Scholar 

  32. Krupinski, E.A.: Current perspectives in medical image perception. Atten. Percept. Psychophys. 72(5), 1205–1217 (2010)

    Article  Google Scholar 

  33. Krupinski, E.A.: Improving patient care through medical image perception research. Policy Insights Behav. Brain Sci. 2(1), 74–80 (2015)

    Article  Google Scholar 

  34. Biggs, A.T., Clark, K., Mitroff, S.R.: Who should be searching? Differences in personality can affect visual search accuracy. Personality Individ. Differ. 116, 353–358 (2017)

    Article  Google Scholar 

  35. Felleman, D.J., Van Essen, D.C.: Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex (New York) 1(1), 1–47 (1991)

    Google Scholar 

  36. Rauthmann, J.F., Seubert, C.T., Sachse, P., Furtner, M.R.: Eyes as windows to the soul: gazing behavior is related to personality. J. Res. Pers. 46(2), 147–156 (2012)

    Article  Google Scholar 

  37. Emery, N.J.: The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci. Biobehav. Rev. 24, 581–604 (2000)

    Article  Google Scholar 

  38. Isaacowitz, D.M.: The gaze of the optimist. Pers. Soc. Psychol. Bull. 31, 407–415 (2005)

    Article  Google Scholar 

  39. Risko, E.F., Anderson, N.C., Lanthier, S., Kingstone, A.: Curious eyes: Individual differences in personality predict eye movement behavior in scene-viewing. Cognition 122, 86–90 (2012)

    Article  Google Scholar 

  40. Baranes, A., Oudeyer, P.Y., Gottlieb, J.: Eye movements reveal epistemic curiosity in human observers. Vis. Res. 117, 81–90 (2015)

    Article  Google Scholar 

  41. Bulling, A., Zander, T.O.: Cognition-aware computing. IEEE Perv. Comput. 13, 80–83 (2014)

    Article  Google Scholar 

  42. Bixler, R., D’Mello, S.: Automatic gaze-based user-independent detection of mind wandering during computerized reading. User Model. User-Adap. Inter. 26(1), 33–68 (2015). https://doi.org/10.1007/s11257-015-9167-1

    Article  Google Scholar 

  43. Hoppe, S., Loetscher, T., Morey, S., Bulling, A.: Recognition of curiosity using eye movement analysis. In: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015) (Osaka), 185–188 (2015)

    Google Scholar 

  44. Al-Samarraie, H., Sarsam, S.M., Alzahrani, A.I., Alalwan, N., Masood, M.: The role of personality characteristics in informing our preference for visual presentation: an eye movement study. J. Ambient Intell. Smart Environ. 8(6), 709–719 (2016)

    Article  Google Scholar 

  45. Al-Samarraie, H., Sarsam, S.M., Alzahrani, A.I., Alalwan, N.: Personality and individual differences: the potential of using preferences for visual stimuli to predict the Big Five traits. Cogn. Technol. Work 20(3), 337–349 (2018). https://doi.org/10.1007/s10111-018-0470-6

    Article  Google Scholar 

  46. Goldberg, L.R.: The development of markers for the Big-Five factor structure. Psychol. Assess. 4(1), 26–42 (1992)

    Article  Google Scholar 

  47. R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.r-project.org/ (2019)

  48. Wickham, H., Henry, L., RStudio.: Tidyr: easily Tidy Data with “Spread” and “Gather” Functions. https://cran.r-project.org/package=tidyr (2019)

  49. Kuhn, M.: Building predictive models in R using the caret package. J. Stat. Softw. 28(1), 1–26 (2008)

    MathSciNet  Google Scholar 

  50. Ge, X., Pan, Y., Wang, S., Qian, L., Yuan, J., Jie, X., Y., Qian: Improving intention detection in single-trial classification through fusion of EEG and eye-tracker data. IEEE Trans. Hum.-Mach. Syst. 53(1), 132–141 (2023). https://doi.org/10.1109/THMS.2022.3225633

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by the National Natural Science Foundation of China (Grant No. T2192931).

Author information

Authors and Affiliations

  1. Zhejiang University, Hangzhou, China

    Yunxian Pan & Jie Xu

Authors
  1. Yunxian Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jie Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jie Xu .

Editor information

Editors and Affiliations

  1. Aaron Marcus and Associates, Berkeley, CA, USA

    Aaron Marcus

  2. World Usability Day and Bubble Mountain Consulting, Newton Center, MA, USA

    Elizabeth Rosenzweig

  3. Southern University of Science and Technology – SUSTech, Shenzhen, China

    Marcelo M. Soares

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pan, Y., Xu, J. (2023). Personality Traits Inference in the Hybrid Foraging Search Task. In: Marcus, A., Rosenzweig, E., Soares, M.M. (eds) Design, User Experience, and Usability. HCII 2023. Lecture Notes in Computer Science, vol 14032. Springer, Cham. https://doi.org/10.1007/978-3-031-35702-2_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35702-2_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35701-5

  • Online ISBN: 978-3-031-35702-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation