Skip to main content
SpringerLink
Log in

Comparison of Two Methods for Altering the Appearance of Interviewers: Analysis of Multiple Biosignals

  • Conference paper
  • First Online:
Engineering Psychology and Cognitive Ergonomics (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14017))

Included in the following conference series:

  • 710 Accesses

Abstract

This study uses a simulation of an actual video interview to compare the effects of acquaintance and animated character scenes as interviewers on participants’ mental stress and perceptions. The acquaintance group tended to have lower anxiety levels in the self-state anxiety assessment and in the change in nasal tip temperature during the anticipation and presentation phases. Furthermore, the results of eye movements during the presentation showed that the acquaintance group paid more attention to the interviewer and perceived the interviewer with a higher frequency than the animated character group. In addition, we used the functional Near-Infrared Spectroscopy (fNIRS) technique to explore the effects of interview stress on brain activity. The stranger group tended to increase cerebral blood flow in both the left and right prefrontal cortices of the participants within 4 s of meeting the interviewer on the screen. This result may be related to mental stress, which promotes the brain’s regulatory function.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Snap Inc.

  2. 2.

    Nippon Avionics Co., Ltd.

  3. 3.

    Tobii Technology Inc.

  4. 4.

    NeU Crop.

  5. 5.

    Mathworks.

  6. 6.

    Tobii Technology Inc.

References

  1. Alievk: Alievk/avatarify-desktop: Successor of avatarify python. https://github.com/alievk/avatarify-desktop

  2. Arnsten, A.F.: Stress signalling pathways that impair prefrontal cortex structure and function. Nat. Rev. Neurosci. 10(6), 410–422 (2009)

    Article  Google Scholar 

  3. Bailenson, J.N., Beall, A.C.: Transformed social interaction: exploring the digital plasticity of avatars. In: Avatars at Work and Play: Collaboration and Interaction in Shared Virtual Environments, pp. 1–16 (2006)

    Google Scholar 

  4. Boas, D.A., Elwell, C.E., Ferrari, M., Taga, G.: Twenty years of functional near-infrared spectroscopy: introduction for the special issue (2014)

    Google Scholar 

  5. CD, S.: State-trait anxiety inventory. A comprehensive bibliography (1983)

    Google Scholar 

  6. Chan, S.W., Gunasekaran, T.S., Pai, Y.S., Zhang, H., Nanayakkara, S.: Kinvoices: using voices of friends and family in voice interfaces. Proc. ACM Hum.-Comput. Interact. 5(CSCW2), 1–25 (2021)

    Article  Google Scholar 

  7. Cho, Y., Bianchi-Berthouze, N.: Physiological and affective computing through thermal imaging: a survey. arXiv preprint arXiv:1908.10307 (2019)

  8. Clark, D.M., Wells, A.: A cognitive model of social phobia. Social phobia: Diagnosis, assessment, and treatment (1995)

    Google Scholar 

  9. Craven, M.: Effects of self-focused attention and fear of evaluation on anxiety and perception of speech performance. Ph.D. thesis, Ohio university (2015)

    Google Scholar 

  10. De Wachter, J., et al.: Prefrontal cortex oxygenation during endurance performance: a systematic review of functional near-infrared spectroscopy studies. Front. Physiol., 1834 (2021)

    Google Scholar 

  11. Engert, V., Merla, A., Grant, J.A., Cardone, D., Tusche, A., Singer, T.: Exploring the use of thermal infrared imaging in human stress research. PloS One 9(3), e90782 (2014)

    Article  Google Scholar 

  12. Ferrari, M., Quaresima, V.: A brief review on the history of human functional near-infrared spectroscopy (fnirs) development and fields of application. Neuroimage 63(2), 921–935 (2012)

    Article  Google Scholar 

  13. Ghanbari, L., Wang, C., Jeon, H.W.: Industrial energy assessment training effectiveness evaluation: An eye-tracking study. Sensors 21(5), 1584 (2021)

    Article  Google Scholar 

  14. Giannakakis, G., Grigoriadis, D., Giannakaki, K., Simantiraki, O., Roniotis, A., Tsiknakis, M.: Review on psychological stress detection using biosignals. IEEE Trans. Affect. Comput. 13(1), 440–460 (2019)

    Article  Google Scholar 

  15. Goldman, M.: Effect of eye contact and distance on the verbal reinforcement of attitude. J. Soc. Psychol. 111(1), 73–78 (1980)

    Article  Google Scholar 

  16. Huppert, T.J., Diamond, S.G., Franceschini, M.A., Boas, D.A.: Homer: a review of time-series analysis methods for near-infrared spectroscopy of the brain. Appl. Opt. 48(10), D280–D298 (2009)

    Article  Google Scholar 

  17. Kaur, A., Smith, C.E., Terveen, L.: Sway together, stay together: visualizing spiritual support networks through the soulgarden prototype. In: Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing, pp. 84–88 (2021)

    Google Scholar 

  18. Kocur, M., Schauhuber, P., Schwind, V., Wolff, C., Henze, N.: The effects of self-and external perception of avatars on cognitive task performance in virtual reality. In: 26th ACM Symposium on Virtual Reality Software and Technology, pp. 1–11 (2020)

    Google Scholar 

  19. von Lühmann, A., Li, X., Müller, K.R., Boas, D.A., Yücel, M.A.: Improved physiological noise regression in fnirs: a multimodal extension of the general linear model using temporally embedded canonical correlation analysis. NeuroImage 208, 116472 (2020)

    Article  Google Scholar 

  20. Martens, R., Vealey, R.S., Burton, D.: Competitive anxiety in sport. Human kinetics (1990)

    Google Scholar 

  21. McCarthy, J., Goffin, R.: Measuring job interview anxiety: beyond weak knees and sweaty palms. Pers. Psychol. 57(3), 607–637 (2004)

    Article  Google Scholar 

  22. Mehrabian, A.: Nonverbal betrayal of feeling. J. Exp. Res. Pers. 5, 64–73 (1971)

    Google Scholar 

  23. Murayama, Y., Hu, L., Sakatani, K.: Relation between prefrontal cortex activity and respiratory rate during mental stress tasks: a near-infrared spectroscopic study. In: Luo, Q., Li, L.Z., Harrison, D.K., Shi, H., Bruley, D.F. (eds.) Oxygen Transport to Tissue XXXVIII. AEMB, vol. 923, pp. 209–214. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-38810-6_28

    Chapter  Google Scholar 

  24. Nozawa, T., Sasaki, Y., Sakaki, K., Yokoyama, R., Kawashima, R.: Interpersonal frontopolar neural synchronization in group communication: an exploration toward fnirs hyperscanning of natural interactions. Neuroimage 133, 484–497 (2016)

    Article  Google Scholar 

  25. Tang, X., Liu, Q., Cai, F., Tian, H., Shi, X., Tang, S.: Prevalence of social anxiety disorder and symptoms among chinese children, adolescents and young adults: a systematic review and meta-analysis. Front. Psychol. 13 (2022)

    Google Scholar 

  26. Villringer, A., Chance, B.: Non-invasive optical spectroscopy and imaging of human brain function. Trends Neurosci. 20(10), 435–442 (1997)

    Article  Google Scholar 

  27. Vinkers, C.H., et al.: The effect of stress on core and peripheral body temperature in humans. Stress 16(5), 520–530 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

We are very grateful to Mr. Teru KAWAKITA for his guidance on the experimental design and to Mr. KECHENG LAI for his advice on the analysis of fNIRS data. We would like to thank Editage (https://www.editage.com/) for English language editing.

Author information

Authors and Affiliations

  1. Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi, Ishikawa, 923-1292, Japan

    Ziting Gong & Hideaki Kanai

Authors
  1. Ziting Gong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hideaki Kanai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hideaki Kanai .

Editor information

Editors and Affiliations

  1. Coventry University, Coventry, UK

    Don Harris

  2. Cranfield University, Cranfield, UK

    Wen-Chin Li

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gong, Z., Kanai, H. (2023). Comparison of Two Methods for Altering the Appearance of Interviewers: Analysis of Multiple Biosignals. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2023. Lecture Notes in Computer Science(), vol 14017. Springer, Cham. https://doi.org/10.1007/978-3-031-35392-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35392-5_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35391-8

  • Online ISBN: 978-3-031-35392-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation